# Robots.txt file from http://www.searchengineworld.com User-agent: * Disallow: membernews.php Disallow: /news/ Disallow: /media/ Disallow: /includes/ Disallow: /downloads/