Site Administration

Controlling Access with Robots.txt for Drupal 6

This page is archived

We're keeping this page up as a courtesy to folks who may need to refer to old instructions. We don't plan to update this page.

Sprout Video

Goes through the best practices for setting up your robots.txt file so that you can prevent the search engines from crawling specific pages on your Drupal site.