# /robots.txt file for Disallow: / # 2009/08/26 18:50 User-agent: Mediapartners-Google Crawl-delay: 100 Allow: / User-agent: Googlebot Disallow: /wp-content/uploads/ Allow: / User-agent: msnbot Disallow: /wp-content/uploads/ Allow: / User-Agent: Yahoo! Slurp Disallow: /wp-content/uploads/ Allow: / User-agent: Yahoo-NewsCrawler Disallow: /wp-content/uploads/ Allow: / User-agent: BecomeBot Crawl-Delay: 100 Disallow: /wp-content/uploads/ Allow: / User-agent: Fasterfox Disallow: / User-agent: baiduspider Disallow: / User-agent: * Crawl-delay: 100 Disallow: /wp-content/uploads/ Disallow: /wp-* Allow: / User-agent: Megalodon Disallow: /