User-agent: Slurp Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: WEP Search Disallow: / User-agent: Program Shareware Disallow: / User-agent: Mac Finder Disallow: / User-agent: WebCopier Disallow: / User-agent: Missigua Locator Disallow: / User-agent: Rad Viewer Version Disallow: / User-agent: Green Research, Inc. Disallow: / User-agent: River Valley Inc Disallow: / User-agent: * allow: /cgi-bin/vmw.cgi allow: /cgi-bin/BookRead.cgi allow: /cgi-bin/dns.cgi allow: /cgi-bin/BlackListed.cgi User-agent: * Disallow: /Server/ Disallow: /PrivateResearch/