# All robots will spider the domain User-agent: Googlebot-Image Disallow: / User-agent: Yahoo-MMCrawler Disallow: / User-agent: * Disallow: /media/ Disallow: /public/ Disallow: /genealog/