User-agent: Googlebot
User-agent: msnbot
User-agent: yahoobot
User-agent: ABCdatos BotLink 
User-agent: Acme.Spider 
User-agent: Ahoy! The Homepage Finder 
User-agent: Alkaline 
User-agent: Anthill 
User-agent: Walhello appie 
User-agent: Arale
User-agent: Araneo 
User-agent: AraybOt 
User-agent: DNAbot 
User-agent: DragonBot 
User-agent: ELFINBOT 
User-agent: FastCrawler 
User-agent: Freecrawl 
User-agent: GetBot 
User-agent: Gulper Bot 
User-agent: HamBot 
User-agent: iajaBot 
User-agent: Infoseek Sidewinder 
User-agent: InfoSeek Robot 1.0 
User-agent: InfoSpiders 
User-agent: I, Robot 
User-agent: JCrawler 
User-agent: AskJeeves 
User-agent: Jobot 
User-agent: JoeBot 
User-agent: JumpStation 
User-agent: LinkWalker 
User-agent: MediaFox 
User-agent: MerzScope 
User-agent: Monster 
User-agent: NDSpider 
User-agent: NDSpider 
User-agent: NetCarta WebMap Engine 
User-agent: NetMechanic 
User-agent: NetScoop 
User-agent: newscan-online 
User-agent: NHSE Web Forager 
User-agent: Nomad 
User-agent: The NorthStar Robot 
User-agent: ObjectsSearch 
User-agent: Occam 
User-agent: HKU WWW Octopus 
User-agent: OntoSpider 
User-agent: Openfind data gatherer 
User-agent: Orb Search 
User-agent: Pack Rat 
User-agent: PageBoy 
User-agent: ParaSite 
User-agent: Patric 
User-agent: pegasus 
User-agent: The Peregrinator 
User-agent: PerlCrawler 1.0 
User-agent: Phantom 
User-agent: PhpDig 
User-agent: PiltdownMan 
User-agent: Pimptrain.com's robot 
User-agent: Pioneer 
User-agent: html_analyzer 
User-agent: Portal Juice Spider 
User-agent: PGP Key Agent 
User-agent: PlumtreeWebAccessor 
User-agent: Poppi 
User-agent: PortalB Spider 
User-agent: psbot 
User-agent: GetterroboPlus Puu 
User-agent: The Python Robot 
User-agent: Raven Search 
User-agent: RBSE Spider 
User-agent: Resume Robot 
User-agent: RoadHouse Crawling System 
User-agent: RixBot 
User-agent: Road Runner: The ImageScape Robot 
User-agent: Robbie the Robot 
User-agent: ComputingSite Robi/1.0 
User-agent: RoboCrawl Spider 
User-agent: User-agent: RoboFox 
User-agent: Robozilla 
User-agent: Roverbot 
User-agent: RuLeS 
User-agent: SafetyNet Robot 
User-agent: Scooter 
User-agent: Search.Aus-AU.COM 
User-agent: Sleek 
User-agent: SearchProcess 
User-agent: Senrigan 
User-agent: SG-Scout 
User-agent: ShagSeeker 
User-agent: Shai'Hulud 
User-agent: Sift 
User-agent: Simmany Robot Ver1.0 
User-agent: Site Valet 
User-agent: SiteTech-Rover 
User-agent: Skymob.com 
User-agent: SLCrawler 
User-agent: Inktomi Slurp 
User-agent: Smart Spider 
User-agent: Snooper 
User-agent: Solbot 
User-agent: Speedy Spider 
User-agent: spider_monkey 
User-agent: SpiderBot 
User-agent: Spiderline Crawler 
User-agent: SpiderMan 
User-agent: SpiderView(tm) 
User-agent: Spry Wizard Robot 
User-agent: Site Searcher 
User-agent: Suke 
User-agent: suntek search engine 
User-agent: Sven 
User-agent: Sygol 
User-agent: TACH Black Widow 
User-agent: Tarantula 
User-agent: tarspider 
User-agent: Tcl W3 Robot 
User-agent: TechBOT 
User-agent: Templeton 
User-agent: TitIn 
User-agent: TITAN 
User-agent: The TkWWW Robot 
User-agent: TLSpider 
User-agent: UCSD Crawl 
User-agent: UdmSearch 
User-agent: UptimeBot 
User-agent: URL Check 
User-agent: URL Spider Pro 
User-agent: Valkyrie 
User-agent: Verticrawl 
User-agent: Victoria 
User-agent: vision-search 
User-agent: void-bot 
User-agent: Voyager 
User-agent: VWbot 
User-agent: The NWI Robot 
User-agent: W3M2 
User-agent: WallPaper (alias crawlpaper) 
User-agent: w@pSpider by wap4.com 
User-agent: WebBandit Web Spider 
User-agent: WebCatcher 
User-agent: WebCopy 
User-agent: webfetcher 
User-agent: The Webfoot Robot 
User-agent: Webinator 
User-agent: weblayers 
User-agent: WebLinker 
User-agent: WebMirror 
User-agent: The Web Moose 
User-agent: WebQuest 
User-agent: Digimarc MarcSpider 
User-agent: WebReaper 
User-agent: webs 
User-agent: Websnarf 
User-agent: WebSpider 
User-agent: WebVac 
User-agent: webwalk 
User-agent: WebWalker 
User-agent: WebWatch 
User-agent: Wget 
User-agent: whatUseek Winona 
User-agent: WhoWhere Robot 
User-agent: Weblog Monitor 
User-agent: w3mir 
User-agent: WebStolperer 
User-agent: The Web Wombat 
User-agent: WWWC Ver 0.2.5 
User-agent: WebZinger 
User-agent: XGET 
User-agent: Nederland.zoek 
Disallow: