PenetrationTestingScripts/User Agents/csv/ua_org_allagents.csv

1	description	ua
2	Sync2It bookmark management & clustering engine	!Susie (http://www.sync2it.com/susie)
3	UnCHAOS search robot	<a href='http://www.unchaos.com/'> UnChaos </a> From Chaos To Order Hybrid Web Search Engine.(vadim_gonchar@unchaos.com)
4	UnCHAOS search robot	<a href='http://www.unchaos.com/'> UnChaos Bot Hybrid Web Search Engine. </a> (vadim_gonchar@unchaos.com)
5	UnCHAOS search robot	<b> UnChaosBot From Chaos To Order UnChaos Hybrid Web Search Engine at www.unchaos.com </b> (info@unchaos.com)
6	Sygol Search (Italy) robot	<http://www.sygol.com/> http://www.sygol.com
7	SearchEngineWorld's robots.txt validator	( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi )
8	DreamCast DreamPassport browser	(DreamPassport/3.0; isao/MyDiGiRabi)
9	Privoxy web proxy	(Privoxy/1.0)
10	Unknown Yahoo robot	*/Nutch-0.9-dev
11	SitiDi.net search (Germany) robot	+SitiDi.net/SitiDiBot/1.0 (+Have Good Day)
12	Die Kraehe Meta-Search-Engine (Germany) link checking	-DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de
13	123spider.de (Germany) web directory link checking	123spider-Bot (Version: 1.02, powered by www.123spider.de
14	192.com - UK web directory	192.comAgent
15	1st ZipCommander Net - IE based browser	1st ZipCommander (Net) - http://www.zipcommander.com/
16	2Bone online link checker	2Bone_LinkChecker/1.0 libwww-perl/5.64
17	4Anything robot	4anything.com LinkChecker v2.0
18	Unknown guestbook spamming or harvesting tool from diff. IPs	8484 Boston Project v 1.0
19	neofonie search robot Germany	:robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html )
20	A-Online.at robot - now Jet2Web Search	A-Online Search
21	A1 Keyword Research - search engine and keyword optimization software	A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27
22	MiggiBot website crawler engine - A1 Sitemap Generator	A1 Sitemap Generator/1.0 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2006.01.24
23	Aardvark web crawler for Sun's Blog recommendations	aardvark-crawler
24	Abacho / Crawler.de robot	AbachoBOT
25	Abacho / Crawler.de robot	AbachoBOT (Mozilla compatible)
26	ABCdatos - Castilian program & tutorial directory	ABCdatos BotLink/5.xx.xxx#BBL
27	Aberja Hybridsuchmaschine (Germany) link checking	Aberja Checkomat
28	Nameprotect copyright search robot (24.177.134.x)	abot/0.1 (abot; http://www.abot.com; abot@abot.com)
29	About robot	About/0.1libwww-perl/5.47
30	Accela Technology RSS feed crawler	Accelatech RSSCrawler/0.4
31	Accoona Search robot	accoona
32	Accoona Search robot	Accoona-AI-Agent/1.1.1 (crawler at accoona dot com)
33	Accoona Search robot	Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)
34	Ace Explorer - IE based browser	Ace Explorer
35	Ackerm search robot	Ack (http://www.ackerm.com/)
36	Acoi picture finder robot	AcoiRobot
37	Acoon.de search (Germany) robot	Acoon Robot v1.50.001
38	Acoon.de search (Germany) robot	Acoon Robot v1.52 (http://www.acoon.de)
39	Acoon.de search (Germany) robot	Acoon-Robot 4.0.x.[xx] (http://www.acoon.de)
40	Acoon.de search (Germany) robot	Acoon-Robot v3.xx (http://www.acoon.de and http://www.acoon.com)
41	Acorn Search Project	Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org)
42	LibMaster.com Active Bookmark HTML page creator	ActiveBookmark 1.x
43	Activeworlds 3D homepage browser	Activeworlds
44	Activeworlds 3D homepage browser	ActiveWorlds/3.xx (xxx)
45	Ad Muncher - banner killer	Ad Muncher v4.xx.x
46	Ad Muncher - banner killer	Ad Muncher v4x Build xxxxx
47	website directory adaxas link checking	Adaxas Spider (http://www.adaxas.net/)
48	Avant Browser - IE based browser	Advanced Browser (http://www.avantbrowser.com)
49	Aesop robot	AESOP_com_SpiderMan
50	Agada search (Germany) robot	agadine/1.x.x (+http://www.agada.de)
51	SharewarePlaza link checking	Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com)
52	Linkomatic submission verifier	AgentName/0.1 libwww-perl/5.48
53	21seek.com (China) robot (218.17.90.xxx)	AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China)
54	AideRss - Postrank RSS and Blog filtering	AideRSS/1.0 (aiderss.com)
55	Nameprotect copyright search robot (24.177.134.x)	aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)
56	Nameprotect copyright search robot (24.177.134.x)	aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com)
57	Akregator news feed reader for KDE	Akregator/1.2.9; librss/remnants
58	Aladin robot	Aladin/3.324
59	Phone.com UP.Browser for mobiles on Alcatel cellphone	Alcatel-BG3/1.0 UP.Browser/5.0.3.1.2
60	Aleksika Danmark - Search engine optimization spider	Aleksika Spider/1.0 (+http://www.aleksika.com/)
61	Alertinfo - French version of Feedreader 3.xx	AlertInfo 2.0 (Powered by Newsbrain)
62	Vestris robot	AlkalineBOT/1.3
63	Vestris robot	AlkalineBOT/1.4 (1.4.0326.0 RTM)
64	Allesklar.de robot	Allesklar/0.1 libwww-perl/5.46
65	Alligator download manager	Alligator 1.31 (www.nearsoftware.com)
66	Unknown robot from Allrati.com	Allrati/1.1 (+)
67	Altavista robot	AltaVista Intranet V2.0 AVS EVAL search@freeit.com
68	Altavista robot	AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net
69	Altavista robot	AltaVista Intranet V2.0 evreka.com crawler@evreka.com
70	Altavista robot	AltaVista V2.0B crawler@evreka.com
71	Amaya - W3C's Editor/Browser	amaya/x.xx libwww/x.x.x
72	Amfibi Search robot	AmfibiBOT
73	Amfibi Search robot	Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com)
74	Amfibi Search robot	Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)
75	amibot - Amidalla search engine robot (62.241.33.xx)	amibot
76	AWeb Amiga browser	Amiga-AWeb/3.4.167SE
77	Voyager - Amiga browser	AmigaVoyager/3.4.4 (MorphOS/PPC native)
78	Amiga Miami TCP Stack	AmiTCP Miami (AmigaOS 2.04)
79	NF embedded browser on Amois Skypephone	Amoi 8512/R21.0 NF-Browser/3.3
80	Amazon.com robot for checking their affiliate sites	amzn_assoc
81	Annomille Italian historical oriented robot	AnnoMille spider 0.1 alpha - http://www.annomille.it
82	annotate Google - Firefox extension for annotating Google search results	annotate_google; http://ponderer.org/download/annotate_google.user.js
83	Megaproxy user	Anonymized by ProxyOS: http://www.megaproxy.com
84	faked user agent	Anonymizer/1.1
85	AnswerBus natural language search using COLLATE technology	AnswerBus (http://www.answerbus.com/)
86	AnswerChase search tool	AnswerChase PROve x.0
87	AnswerChase search tool	AnswerChase x.0
88	ANT Fresco Browser	ANTFresco/x.xx
89	Antibot (discontinued) robot	antibot-V1.1.5/i586-linux-2.2
90	Anzwers (Yahoo) Australia robot	AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine)
91	Apexoo Search spider	Apexoo Spider 1.x
92	JavaOS app. for SEGA Saturn Internet and Sanyo Internet-TV	Aplix HTTP/1.0.1
93	JavaOS app. for Sanyo Internet-TV	Aplix_SANYO_browser/1.x (Japanese)
94	JavaOS app. for SEGA Saturn Internet	Aplix_SEGASATURN_browser/1.x (Japanese)
95	Aport robot	Aport
96	Walhello Internet Search robot	appie 1.1 (www.walhello.com)
97	CoreMedia player on Apple iPhone	Apple iPhone v1.1.4 CoreMedia v1.0.0.4A102
98	PubSub - Mac OS X utility for managing RSS/Atom subscriptions via the PubSub framework	Apple-PubSub/65.1.1
99	Araby search - Arabia	ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;)
100	Covac Arachnid Web Crawler	ArachBot
101	Euroseek spider	Arachnoidea (arachnoidea@euroseek.com)
102	Amazon.com robot for checking their affiliate sites	aranhabot
103	Excite spider	ArchitextSpider
104	Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx)	archive.org_bot
105	Simpy Bookmarklet crawler (69.55.233.xx)	Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com)
106	Arikus inContext search engine software	Arikus_Spider
107	Tomba project: the Portuguese web archive	Arquivo-web-crawler (compatible; heritrix/1.12.1 +http://arquivo-web.fccn.pt)
108	Asaha search robot (Turkey)	ASAHA Search Engine Turkey V.001 (http://www.asaha.com/)
109	ASAHINA Antenna information detecting agent	Asahina-Antenna/1.x
110	ASAHINA Antenna information detecting agent	Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x)
111	Ask 24x Info robot	ask.24x.info
112	Ask About Oil - Petroleum related search (24.227.212.xxx) using Nutch	AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com)
113	askEd! / Inferret search (Japan) robot using Nutch	asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com)
114	ASPSeek search engine software -Yahoo-Inc. / Telecom Canada robot	ASPSeek/1.2.5
115	Swsoft.net robot using Aspseek	ASPseek/1.2.9d
116	ASPSeek search engine software	ASPSeek/1.2.x
117	ASPSeek search engine software	ASPSeek/1.2.xa
118	ASPSeek search engine software	ASPseek/1.2.xx
119	ASPSeek search engine software	ASPSeek/1.2.xxpre
120	Associative Sort robot	ASSORT/0.10
121	Singingfish media spider (64.12.186.2xx) via AOL search	asterias/2.0
122	Atlocal local business search robot	AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)
123	Atomic Email Hunter email extracing and harvesting	Atomic_Email_Hunter/4.0
124	Atomz robot	Atomz/1.0
125	atSpider (ceased) email harvester / spambot	atSpider/1.0
126	Attentio social media monitoring and analysing	Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com)
127	Samsung SPH-A660 phone with Sprint software	AU-MIC/2.0 MMP/2.0
128	Audiovox SMT5600 (AT&T) Smartphone mobile phone browser	AUDIOVOX-SMT5600
129	Augurnet Swiss (was www.augurnet.ch) search robot	augurfind
130	Augurnet Swiss (was www.augurnet.ch) search robot	augurnfind V-1.x
131	Auto Email Pro Email harvester	autoemailspider
132	Linkscan tool from Elsop	autohttp
133	Autowebdir - The Automatically Generated Web Directory	autowebdir 1.1 (www.autowebdir.com)
134	Altavista robot ??	AV Fetch 1.0
135	Avant Browser - IE based browser	Avant Browser (http://www.avantbrowser.com)
136	National Research Council Canada robot	AVSearch-1.0(peter.turney@nrc.ca)
137	Unknown robot from 205.203.108.xx (telerate.com)	AVSearch-2.0-fusionIdx-14-CompetitorWebSites
138	Altavista robot	AVSearch-3.0(AltaVista/AVC)
139	AWeb Amiga browser	AWeb
140	Axada search Germany robot	axadine/ (Axadine Crawler; http://www.axada.de/; )
141	Axmo search robot	AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine.
142	Azureus Java BitTorrent Client	Azureus 2.x.x.x
143	Babaloo search robot (Slovenia)	BabalooSpider/1.3 (BabalooSpider; http://www.babaloo.si; spider@babaloo.si)
144	BaBoom Web Portal (ODP) robot (66.98.254.xx)	BaboomBot/1.x.x (+http://www.baboom.us)
145	BackStreet Browser - Offline browser / website downloader	BackStreet Browser 3.x
146	Baidu search (Japan) image crawler	BaiduImagespider+(+http://www.baidu.jp/search/s308.html)
147	Baidu spidering engine - used by diff. IPs	BaiDuSpider
148	Baidu spidering engine - used by diff. IPs	Baiduspider+(+http://help.baidu.jp/system/05.html)
149	Baidu spidering engine - used by diff. IPs	Baiduspider+(+http://www.baidu.com/search/spider.htm)
150	Baidu search (Japan) crawler	Baiduspider+(+http://www.baidu.com/search/spider_jp.html)
151	Balihoo - Vertical search engine crawler (beta)	Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com)
152	Project BanBots Perl script robot	BanBots/1.2 (spider@banbots.com)
153	Barca Pro email & PIM software	Barca/2.0.xxxx
154	Barca Pro email & PIM software	BarcaPro/1.4.xxxx
155	Barrahome crawler	BarraHomeCrawler (albertof@barrahome.org)
156	Unknown user agent from Microsoft	bCentral Billing Post-Process
157	Business.com robot	bdcindexer_2.6.2 (research@bdc)
158	Brandimensions Brand Protection robot	BDFetch
159	Bdncentral Sitesearch robot	BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686)
160	beammachine web directory (Germany) link checking	BeamMachine/0.5 (dead link remover of www.beammachine.net)
161	Beauty robot for Cosmoty - German beauty and wellness search	beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/)
162	A Passion for Jazz music related search robot	BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html )
163	LinkcheckerBeepware (site is down) web directory link checking	BeebwareDirectory/v0.01
164	Big Brother link checking tool	Big Brother (http://pauillac.inria.fr/~fpottier/)
165	GoonGee.com link popularity checking	Big Fish v1.0
166	BB4 network monitoring	BigBrother/1.6e
167	BigClique Search robot	BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com)
168	Biglotron search (France) robot	BIGLOTRON (Beta 2;GNU/Linux)
169	Bigsearch.ca search robot	Bigsearch.ca/Nutch-x.x-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)
170	Bilbo - web frontend for the Nessus Security Scanner	Bilbo/2.3b-UNIX
171	Bilgi.com (Beta) search robot - Turkey	BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)
172	Bilgi.com (Beta) search robot - Turkey	BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com)
173	Carnegie Mellon School robot/link checking ?	billbot wjj@cs.cmu.edu
174	Bitacle Blog Search Archive robot	Bitacle bot/1.1
175	Bitacle Blog Search Archive robot	Bitacle Robot (V:1.0;) (http://www.bitacle.com)
176	Biyubi Navigator - Mexican browser for Fenix OS	Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx)
177	Blackberry Wireless Internet browser via Google WAP Proxy	BlackBerry7520/4.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/5.0.3.3 UP.Link/5.1.2.12 (Google WAP Proxy/1.0)
178	FS Consulting (was www.fsconsult.net) Black Widow web crawler	BlackWidow
179	BlackWidow web site scanner / downloading tool	BlackWidow
180	Blaiz Enterprises RawGrunt search	Blaiz-Bee/1.0 (+http://www.blaiz.net)
181	Blaiz Enterprises RawGrunt search	Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com)
182	Blaiz Enterprises RawGrunt search	Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net)
183	Blitzsuche Germany robot	BlitzBOT@tricus.net
184	Blitzsuche Germany robot	BlitzBOT@tricus.net (Mozilla compatible)
185	BlockNote web page editor	BlockNote.Net
186	blogdex robot from MIT.edu	BlogBot/1.x
187	BlogBridge RSS reader	BlogBridge 2.13 (http://www.blogbridge.com/)
188	Bloglines article search	Bloglines Title Fetch/1.0 (http://www.bloglines.com)
189	Bloglines graphics crawler	Bloglines-Images/0.1 (http://www.bloglines.com)
190	Bloglines news crawler	Bloglines/3.1 (http://www.bloglines.com)
191	FeedMap / BlogMap geo coding service	BlogMap (http://www.feedmap.net)
192	Intelliseek's BlogPulse blog search	Blogpulse (info@blogpulse.com)
193	Intelliseek's BlogPulse blog search	BlogPulseLive (support@blogpulse.com)
194	IceRocket Web search robot	BlogSearch/1.x +http://www.icerocket.com/
195	Art of Computing blog search project	blogsearchbot-pumpkin-3
196	BlogsNow realtime link tracker robot	BlogsNowBot, V 2.01 (+http://www.blogsnow.com/)
197	BlogVipe news and Blog crawler (Netherlands)	BlogVibeBot-v1.1 (spider@blogvibe.nl)
198	blogWatcher robot from Okumura Group Tokyo (131.112.182.xxx)	blogWatcher_Spider/0.1 (http://www.lr.pi.titech.ac.jp/blogWatcher/)
199	IceRocket Web search robot	BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com)
200	IceRocket Web search robot	BlogzIce/1.0 +http://www.icerocket.com/
201	Blooby search (beta) robot	BloobyBot
202	Balihoo - Search Engine for Advertising Media	Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com)
203	Bluefish HTML-editor for Linux	bluefish 0.6 HTML editor
204	Part of ButtMan remote access tool	BMCLIENT
205	Bookmark Express bookmark manager	BMLAUNCHER
206	Bobby web accessibility desktop testing tool	Bobby/4.0.x RPT-HTTPClient/0.3-3E
207	Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx	boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html)
208	Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx	boitho.com-robot/1.x
209	Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx	boitho.com-robot/1.x (http://www.boitho.com/bot.html)
210	Bookdog - Mac bookmark manager	Bookdog/x.x
211	Bookmark Buddy - favorite bookmark manager	Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/)
212	Favourites managing program	Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/]
213	Favourites managing program	Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta)
214	Bookmark Base bookmark manager	BookmarkBase(2/;http://bookmarkbase.com)
215	cybercity.fr user robot / faked user agent ?	Bot mailto:craftbot@yahoo.com
216	BD-Brandprotect copyright infringement crawler	BPImageWalker/2.0 (www.bdbrandprotect.com)
217	BravoBrian bSTOP parental control	BravoBrian bstop.bravobrian.it
218	Robot for BravoBrian bSTOP	BravoBrian SpiderEngine MarcoPolo
219	BrightCloud web filtering for classifying websites	BrightCrawler (http://www.brightcloud.com/brightcrawler.asp)
220	Webarchive Project Bruinbot crawler	BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html)
221	Inktomi (Hotbot-Lycos NBCi) robot	BSDSeek/1.0
222	BravoBrian bSTOP parental control	BStop.BravoBrian.it Agent Detector
223	BitTorrent Search Engine btbot robot	BTbot/0.x (+http://www.btbot.com/btbot.html)
224	µTorrent BitTorrent Client	BTWebClient/180B(9704)
225	BuildCMS crawler - market monitoring project of BuildCMS	BuildCMS crawler (http://www.buildcms.com/crawler)
226	Bulkfeeds: RSS directory link checking	Bulkfeeds/r1752 (http://bulkfeeds.net/)
227	BullsEye/Intelliseek robot	BullsEye
228	Relevare Portal software robot	bumblebee@relevare.com
229	Microsoft server information robot (see link)	BunnySlippers
230	BurstFind search crawler (64.34.172.xx)	BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com)
231	Buscaplus (Spain) robot	Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/)
232	Logitech Desktop Managers (LDM) Backweb (BW) update check	BW-C-2.0
233	Basic Web Hacking 3 fake user-agent from Hellbound Hackers challenges	bwh3_user_agent
234	Amfibi Search robot	Cabot/Nutch-0.9 (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com)
235	Amfibi Search robot	Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com)
236	Evolution integrated mail solution Camel TCP stream class	CamelHttpStream/1.0
237	Some user agent	Cancer Information and Support International;
238	Cosmix project crawler (204.14.48.x / 38.113.234.xxx)	carleson/1.0
239	Carnegie Mellon University WebBOT	Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->http://www.andrew.cmu.edu/~brgordon/webbot/index.html http://www.andrew.cmu.edu/~brgordon/webbot/index.html
240	Carnegie Mellon University WebBOT	Carnegie_Mellon_University_WebCrawler http://www.andrew.cmu.edu/~brgordon/webbot/index.html
241	Catall.de search & web directory (Germany)	Catall Spider
242	UIUCs Cazoodle search based on MetaQuerier	CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)
243	CommonCrawl Foundation search crawler	CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
244	Empyreum Ccubee (Czech) search engine solution	ccubee/x.x
245	Timewe mobile browser (WAP) simulator (Japan)	CDR/1.7.1 Simulator/0.7(+http://timewe.net) Profile/MIDP-1.0 Configuration/CLDC-1.0
246	Cisco Content Engine	CE-Preload
247	Nordic semantic search engine	CentiverseBot
248	Nordic semantic search engine	CentiverseBot - investigator
249	Nordic semantic search engine	CentiverseBot/3.0 (http://www.centiverse-project.net)
250	Floortransformed.com robot (link ckecking ??)	Ceramic Tile Installation Guide (http://www.floorstransformed.com)
251	CERN Line Mode Browser	CERN-LineMode/2.15
252	Cosmix project crawler (204.14.48.x / 38.113.234.xxx)	cfetch/1.0
253	MaxOS X CoreFoundation CFNetwork API	CFNetwork/x.x
254	cg-eye CGI checker	cg-eye interactive
255	Charon Amiga download manager	Charon/1.x (Amiga)
256	Chat Catcher blog monitoring robot	Chat Catcher/1.0
257	Checkbot link validation	Checkbot/1.xx LWP/5.xx
258	Checklinks - Perl link checker	CheckLinks/1.x.x
259	NTL user agent	CheckUrl
260	CheckWeb link validation	CheckWeb
261	Chilkat HTTP component user-agent	Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp)
262	Unknown spam bot from telekom.com.my (218.111.83.xxx)	China Local Browse 2.6
263	Chitika Inc. Blog advertising	Chitika ContentHit 1.0
264	Christcentral.com Christcrawler (was www.christcrawler.com)	ChristCRAWLER 2.0
265	CHttpClient - C++ class using WinInet	CHttpClient by Open Text Corporation
266	CipinetBot -Cipinet Search Engine Web Crawler	CipinetBot (http://www.cipinet.com/bot.html)
267	Cityreview regional search (Germany) link checking	Cityreview Robot (+http://www.cityreview.org/crawler/)
268	Commision Junction link checking spider	CJ Spider/
269	CJB Net anonymous socks proxy service (216.194.70.x)	CJB.NET Proxy
270	Claria (ex Gator) SearchScout robot (64.152.73.xx)	ClariaBot/1.0
271	Claymont Search robot	Claymont.com
272	Seznam Search (Czech Republic) robot	CloakDetect/0.9 (+http://fulltext.seznam.cz/)
273	Clush clustered search robot	Clushbot/2.x (+http://www.clush.com/bot.html)
274	Clush clustered search robot	Clushbot/3.x-BinaryFury (+http://www.clush.com/bot.html)
275	Clush clustered search robot	Clushbot/3.xx-Ajax (+http://www.clush.com/bot.html)
276	Clush clustered search robot	Clushbot/3.xx-Hector (+http://www.clush.com/bot.html)
277	Clush clustered search robot	Clushbot/3.xx-Peleus (+http://www.clush.com/bot.html)
278	COAST Webmaster - Web management and maintenance software	COAST WebMaster Pro/4.x.x.xx (Windows NT)
279	Proposed Content-Based Image Tracking System (CoBITS) P2P crawler	CoBITSProbe
280	Cocoa del.icio.us (social bookmarks manager) client for Mac OS X	Cocoal.icio.us/1.0 (v36) (Mac OS X; http://www.scifihifi.com/cocoalicious)
281	Cogent Search Bot from Cogent Software Solutions for unknown purposes	Cogentbot/1.X (+http://www.cogentsoftwaresolutions.com/bot.html)
282	Cold Fusion server used by various IPs i.e.: - NetWORLD web catalogue link checking	ColdFusion
283	Cold Fusion server used by Bookmark Tracker - online favourites managment	ColdFusion (BookmarkTracker.com)
284	WebCollage Syndicator graphics crawler/collector	collage.cgi/1.xx
285	Combine harvesting & indexing robot	combine/0.0
286	Combine harvesting & indexing robot	Combine/2.0 http://combine.it.lth.se/
287	Combine harvesting & indexing robot	Combine/3 http://combine.it.lth.se/
288	Combine harvesting & indexing robot	Combine/x.0
289	cometrics Web Content Mining solution - Germany	cometrics-bot, http://www.cometrics.de
290	Wildsoft Germany (closed) Internet client system user-agent (was www.oskarweb.de)	Commerce Browser Center
291	UCLA Complex Networks Groups Complex Network Analysis	complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl; nimakhaj@gmail.com)
292	Hungarian Academy of Sciences data mining search	Computer_and_Automation_Research_Institute_Crawler crawler@ilab.sztaki.hu
293	ComRite Chinese Search Engine for Oversea Web Sites (69.248.26.xx)	Comrite/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)
294	unknown	Contact
295	Probably E-Mail harvesting robot - same as LMQueueBot	ContactBot/0.2
296	ContentSmartz e-mail harvesting tools	ContentSmartz
297	Internet Explorer versions 4.x and 5 plugin content	contype
298	Converas RetrievalWare Internet Spider (63.241.61.x)	Convera Internet Spider V6.x
299	Converas RetrievalWare Internet Spider (63.241.61.x)	ConveraCrawler/0.2
300	Converas RetrievalWare Internet Spider (63.241.61.x)	ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)
301	Converas RetrievalWare Internet Spider (63.241.61.x)	ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl)
302	Suchmaschine21 (Germany) robot	CoolBot
303	Cooliris photo and video browser	Cooliris/1.5 CFNetwork/459 Darwin/10.0.0d3
304	Coral Content Distribution Network	CoralWebPrx/0.1.1x (See http://coralcdn.org/)
305	Xyleme SA France robot	cosmos/0.8_(robot@xyleme.com)
306	Xyleme SA France robot	cosmos/0.9_(robot@xyleme.com)
307	Coteo.com - local French directory link checking	CoteoNutchCrawler/Nutch-0.9 (info [at] coteo [dot] com)
308	Cougarsearch.com robot	CougarSearch/0.x (+http://www.cougarsearch.com/faq.shtml)
309	Covac Arachnid Web Crawler	Covac TexAs Arachbot
310	CoverScout for iTunes - CD cover search tool	CoverScout%203/3.0.1 CFNetwork/339.5 Darwin/9.5.0 (i386) (iMac5,1)
311	Naver Japan / Korea robot	Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
312	Naver Japan / Korea robot	Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
313	Converas RetrievalWare Internet Spider	CrawlConvera0.1 (CrawlConvera@yahoo.com)
314	unknown robot via Level3.net	Crawler
315	Cometsystems Comet Search robot via Findwhat (now Miva)	Crawler (cometsearch@cometsystems.com)
316	Crawler.de / Abacho robot	Crawler admin@crawler.de
317	Crawler.de / Abacho robot	Crawler V 0.2.x admin@crawler.de
318	Alexa crawler	crawler@alexa.com
319	Pinpoint WAP search robot	CrawlerBoy Pinpoint.com
320	Crawlly Beta search - Germany (72.232.194.2xx)	Crawllybot/0.1 (Crawllybot; +http://www.crawlly.com; crawler@crawlly.com)
321	Creatice Commons using Nutch open source robot	CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
322	Cricket A100 cell phone browser	Cricket-A100/1.0 UP.Browser/6.3.0.7 (GUI) MMP/2.0
323	Croccrawler robot	CrocCrawler vx.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686)
324	Web mining project from CSCI 659 (computer science course) at Indiana Univerity	csci_b659/0.13
325	CSE HTML Validator for Windows	CSE HTML Validator Professional (http://www.htmlvalidator.com/)
326	Cuam - IE based browser	Cuam Ver0.050bx
327	Cuasar (Spain) music / ringtone search spider	Cuasarbot/0.9b http://www.cuasar.com/spider_beta/
328	Curl file transferring tool	curl/7.10.x (i386-redhat-linux-gnu) libcurl/7.10.x OpenSSL/0.9.7a ipv6 zlib/1.1.4
329	Curl file transferring tool	curl/7.7.x (i386--freebsd4.3) libcurl 7.7.x (SSL 0.9.6) (ipv6 enabled)
330	Curl file transferring tool	curl/7.8 (i686-pc-linux-gnu) libcurl 7.8 (OpenSSL 0.9.6)
331	Curl file transferring tool	curl/7.9.x (win32) libcurl 7.9.x
332	CurryGuide UK link check robot	CurryGuide SiteScan 1.1
333	Custo web site spidering tool (link checking)	Custo x.x (www.netwu.com)
334	Bisnisseek (was www.bisnisseek.com) robot	Custom Spider www.bisnisseek.com /1.0
335	Cyberdog Mac Browser (was www.cyberdog.org)	Cyberdog/2.0 (Macintosh; 68k)
336	CyberPatrol LLC robot for web filtering software	CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp)
337	CyberSpyder Link Test software	CyberSpyder Link Test/2.1.12 (admin@mspennyworth.com)
338	Cydral image & site search spider	CydralSpider/1.x (Cydral Web Image Search; http://www.cydral.com)
339	Cydral image & site search spider	CydralSpider/3.0 (Cydral Image Search; http://www.cydral.com)
340	Downloadaccelerator download manager	DA 3.5 (www.lidan.com)
341	Downloadaccelerator download manager	DA 4.0
342	Downloadaccelerator download manager	DA 4.0 (www.downloadaccelerator.com)
343	Downloadaccelerator download manager	DA 5.0
344	Downloadaccelerator download manager	DA 7.0
345	Download Accelerator Plus download manager	DAP x.x
346	PowerTCP ActiveX control tool	Dart Communications PowerTCP
347	Unknown bot from Kornet Korea (218.149.129.xxx) scans for Perl Awstats	DataCha0s/2.0
348	Unknown UA looking for Awstats Perl components	DataCha0s/2.0
349	INFOMINE/iVia Scholary Internet Resource Collections robot	DataFountains/DMOZ Downloader
350	INFOMINE/iVia Scholary Internet Resource Collections robot	DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml)
351	INFOMINE/iVia Scholary Internet Resource Collections robot	DataFountains/DMOZ Feature Vector Corpus Creator (http://ivia.ucr.edu/useragents.shtml)
352	DataparkSearch open source search engine	DataparkSearch/4.47 (+http://dataparksearch.org/bot)
353	DataparkSearch open source search engine	DataparkSearch/4.xx (http://www.dataparksearch.org/)
354	DataSpear Directory robot (24.109.29.xx)	DataSpear/1.0 (Spider; http://www.dataspear.com/spider.html; spider@dataspear.com)
355	DataSpear Directory robot (24.109.29.xx)	DataSpearSpiderBot/0.2 (DataSpear Spider Bot; http://dssb.dataspear.com/bot.html; dssb@dataspear.com)
356	Sicher-durchs-Netz German security related search (62.75.220.xxx)	DatenBot( http://www.sicher-durchs-netz.de/bot.html)
357	Wholeweb robot	DaviesBot/1.7 (www.wholeweb.net)
358	Daypop blog - weblog - online mag search spider	daypopbot/0.x
359	dbDig search engine	dbDig(http://www.prairielandconsulting.com)
360	Some site scanning tool via diff. IPs i.e.: - wanweb.net (208.6.163.xxx) - cox.net (68.4.xxx.xxx)	DBrowse 1.4b
361	Some site scanning tool via diff. IPs i.e.: - pacbell.net (67.112.xxx.xxx)	DBrowse 1.4d
362	DC-Sakura download manager	DC-Sakura/x.xx
363	unknown divine/Openmarket.com robot	dCSbot/1.1
364	some (website) downloading tool	DDD
365	Unknown user agent	dds explorer v1.0 beta
366	Searchengine.com (Germany) submission checking / robot (84.73.57.xx)	de.searchengine.comBot 1.2 (http://de.searchengine.com/spider)
367	DLC Perl HTTP link checking	DeadLinkCheck/0.4.0 libwww-perl/5.xx
368	Sootle Web Directory deep link checker	Deep Link Calculator v1.0
369	deepak-USC/ISI robot from USC/Information Science Institute	deepak-USC/ISI
370	Deepindex robot	DeepIndex
371	Zetbot search Belgium (213.41.128.xx) using Deepindex robot	DeepIndex ( http://www.zetbot.com )
372	Deepindex robot	DeepIndex (www.en.deepindex.com)
373	Deepindex robot (via Paragon.net Canada)	DeepIndexer.ca
374	del.icio.us picture robot for thumbnail preview via Yahoo	del.icio.us-thumbnails/1.0 Mozilla/5.0 (compatible; Konqueror/3.4; FreeBSD) KHTML/3.4.2 (like Gecko)
375	DeleGate application level gateway / proxy server	DeleGate/9.0.5-fix1
376	Some site scanning tool from 217.34.59.xxx (btopenworld.com)	Demo Bot DOT 16b
377	Some site scanning tool from 68.154.96.xx (bellsouth.net)	Demo Bot Z 16b
378	Denmex Websearch robot/link checking	Denmex websearch (http://search.denmex.com)
379	DataBecker Bilder Sauger (discontinued) web graphics downloader	Der große BilderSauger 2.00u
380	Searchspider.com robot (72.245.225.xxx)	dev-spider2.searchpsider.com/1.3b
381	DevComponents HTMLDocument Class Library for Visual Studio.net	DevComponents.com HtmlDocument Object
382	DiaGem Japan web crawler	DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html)
383	Claria (ex Gator) SearchScout robot (64.152.73.xx)	Diamond/x.0
384	Claria (ex Gator) SearchScout robot (64.152.73.xx)	DiamondBot
385	Diggit! robot	Digger/1.0 JDK/1.3.0rc3
386	OpenPortal4U robot	DigOut4U
387	Findsame.com (site is offline) / Digital-Integrity robot	DIIbot/1.2
388	Dillo Web Browser	Dillo/0.8.5-i18n-misc
389	Dillo Web Browser	Dillo/0.x.x
390	disastrous - a del.icio.us link checker based on Python	disastrous/1.0.5 (running with Python 2.5.1; http://www.bortzmeyer.org/disastrous.html; archangel77@del.icio.us)
391	DISCo Pump offline browser / website ripper	DISCo Pump x.x
392	Unkown robot from Discovery Engine Corp.	disco/Nutch-0.9 (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com)
393	Unkown robot from Discovery Engine Corp.	disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com)
394	Ditto picture search robot	DittoSpyder
395	some download agent	dlman
396	Naver Japan / Korea robot	dloader(NaverRobot)/1.0
397	DNS Right - Online DNS tools	DNSRight.com WebBot Link Ckeck Tool. Report abuse to: dnsr@dnsright.com
398	NTT DoCoMo (Japan) robot	DoCoMo/1.0/Nxxxi/c10
399	NTT DoCoMo (Japan) robot	DoCoMo/1.0/Nxxxi/c10/TB
400	Google (216.239.39.x) proxy server	DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0)
401	NTT DoCoMo (Japan) robot	DoCoMo/2.0 P900iV(c100;TB;W24H11)
402	NTT DoCoMo (Japan) proxy server (210.136.161.1xx)	DoCoMo/2.0 SH901iS(c100;TB;W24H12),gzip(gfe) (via translate.google.com)
403	Yahoo Search Japan robot (203.216.197.xxx)	DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)
404	Yahoo Search Japan robot (203.216.197.xxx)	DoCoMo/2.0/SO502i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)
405	DocZilla - Mozilla-based SGML/XML/HTML- browser	DocZilla/1.0 (Windows; U; WinNT4.0; en-US; rv:1.0.0) Gecko/20020804
406	unknown robot from AGMLAB Information Technologies (Information retrieval system ?)	dodgebot/experimental
407	Donut P - Japanese IE based browser	DonutP; Windows98SE
408	Unknown robot from douban search (China) - maybe image crawling	Doubanbot/1.0 (bot@douban.com http://www.douban.com)
409	Download Demon/Netzip download manager	Download Demon/3.x.x.x
410	Download Druid IE plugin download manager	Download Druid 2.x
411	Download Express download manager	Download Express 1.0
412	Download Master download manager	Download Master
413	Download Ninja download manager (Japan)	Download Ninja 3.0
414	Download Wonder download manager	Download Wonder
415	Download-Tipp Germany link checking	Download-Tipp Linkcheck (http://download-tipp.de/)
416	download.exe .NET based downloading tool	Download.exe(1.1) (+http://www.sql-und-xml.de/freeware-tools/)
417	Download Direct download manager	DownloadDirect.1.0
418	Dr.WEB online virus scanner	Dr.Web (R) online scanner: http://online.drweb.com/
419	Dragonfly CMS - Open Source content management system	Dragonfly File Reader
420	Drecom Japan (210.233.67.xxx) - Blog search ??	Drecombot/1.0 (http://career.drecom.jp/bot.html)
421	Drupal - open source content management platform	Drupal (+http://drupal.org/)
422	Some site scanning tool via diff. IPs i.e.: - cox.net (68.5.xxx.xxx) - pacbell.net (64.16x.xxx.xxx)	DSurf15a 01
423	Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx)	DSurf15a 71
424	Some site scanning tool via diff. IPs i.e.: - verizon.net (4.47.xxx.xxx)	DSurf15a 81
425	Some site scanning tool via diff. IPs i.e.: - eastlink.ca (24.222.xxx.xxx) - cogeco.net (216.221.8x.xxx)	DSurf15a VA
426	DTAAgent Java object for data collecting	DTAAgent
427	dt Search Spider software	dtSearchSpider
428	Fourelle Venturi proxy server	Dual Proxy
429	Duck Duck Go search crawler	DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)
430	DumbFind.com robot	Dumbot(version 0.1 beta - dumbfind.com)
431	DumbFind.com robot	Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html)
432	DumbFind.com robot	Dumbot(version 0.1 beta)
433	Vigiltech e-Sense user research robot (website is offline)	e-sense 1.0 ea(www.vigiltech.com/esensedisclaim.html)
434	e-Society Project (Japan) crawler (133.9.238.xx)	e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)
435	Global Opto's eApollo Flash based search engine - Taiwan	eApolloBot/2.0 (compatible; heritrix/2.0.0-SNAPSHOT-20071024.170148 +http://www.eapollo-opto.com)
436	Earthcom (Czech Republic) search robot (194.108.39.xx)	EARTHCOM.info/1.x [www.earthcom.info]
437	Earthcom (Czech Republic) search robot (194.108.39.xx)	EARTHCOM.info/1.xbeta [www.earthcom.info]
438	Keywen Encyclopedia Bot	EasyDL/3.xx
439	Keywen Encyclopedia Bot	EasyDL/3.xx http://keywen.com/Encyclopedia/Bot
440	Some site scanning tool via diff. IPs i.e.: - swbell.net (65.66.xxx.xxx)	EBrowse 1.4b
441	eCatch (now Wysigot) offline browser	eCatch/3.0
442	Echo.fr robot	EchO!/2.0
443	Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx)	Educate Search VxB
444	Xdefine text search engine robot - based on Egothor open source crawler	egothor/3.0a (+http://www.xdefine.org/robot.html)
445	Egoto Search robot	EgotoBot/4.8 (+http://www.egoto.com/about.htm)
446	eJupiter searcg robot (206.191.49.xx)	ejupiter.com
447	TimelyWeb web page monitoring tool	EldoS TimelyWeb/3.x
448	Elftales crawler for uChoose theme based search (Germany)	elfbot/1.0 (+http://www.uchoose.de/crawler/elfbot/)
449	DAUMOA - RSS search robot of Daum	ELI/20070402:2.0 (DAUM RSS Robot, Daum Communications Corp.; +http://ws.daum.net/aboutkr.html)
450	ELinks text mode browser	ELinks (0.x.x; Linux 2.4.20 i586; 132x60)
451	ELinks text mode browser	ELinks/0.x.x (textmode; NetBSD 1.6.2 sparc; 132x43)
452	Sonic E-mail collector	EmailSiphon
453	EmailSpider E-mail harvesting software	EmailSpider
454	Trellian EMailWolf E-mail collector	EmailWolf 1.00
455	EmeraldShield spam and web filtration services	EmeraldShield.com WebBot
456	EmeraldShield spam and web filtration services	EmeraldShield.com WebBot (http://www.emeraldshield.com/webbot.aspx)
457	Empas search Korea robot (220.95.22x.xxx)	EMPAS_ROBOT
458	Enabot - Enaball semantic search project crawler	EnaBot/1.x (http://www.enaball.com/crawler.html)
459	endo - Mac news site and blog aggregator	endo/1.0 (Mac OS X; ppc i386; http://kula.jp/endo)
460	Enfish Personal search tool	Enfish Tracker
461	Enterprise Search engine software (64.202.165.xxx)	Enterprise_Search/1.0
462	Enterprise Search engine software (64.202.165.xxx)	Enterprise_Search/1.0.xxx
463	Enterprise Search engine software (64.202.165.xxx)	Enterprise_Search/1.00.xxx;MSSQL (http://www.innerprise.net/es-spider.asp)
464	Envolk Web Search robot	envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.php)
465	Envolk Web Search robot	envolk[ITS]spider/1.6(+http://www.envolk.com/envolkspider.html)
466	EroCrawler adult search robot	EroCrawler
467	Enterprise Search engine software (64.202.165.xxx)	ES.NET_Crawler/2.0 (http://search.innerprise.net/)
468	ExactSEEK (Jayde Online) robot	eseek-larbin_2.6.2 (crawler@exactseek.com)
469	ESI Smart-Spider toolkit	ESISmartSpider
470	e-Style ISP search (Russia) robot (217.174.103.xxx)	eStyleSearch 4 (compatible; MSIE 6.0; Windows NT 5.0)
471	Some site scanning tool via diff. IPs	ESurf15a 15
472	Eurip.com - European Internet Portal robot	EuripBot/0.x (+http://www.eurip.com) GetFile
473	Eurip.com - European Internet Portal robot	EuripBot/0.x (+http://www.eurip.com) GetRobots
474	Eurip.com - European Internet Portal robot	EuripBot/0.x (+http://www.eurip.com) PreCheck
475	Ayell Euronet business directory robot	Eurobot/1.0 (http://www.ayell.eu)
476	Evaal Search Engine robot	EvaalSE - bot@evaal.com
477	Eventax event search (Germany)	eventax/1.3 (eventax; http://www.eventax.de/; info@eventax.de)
478	Vulcan Inc. Everest crawler (in development)	Everest-Vulcan Inc./0.1 (R&D project; host=e-1-24; http://everest.vulcan.com/crawlerhelp)
479	Vulcan Inc. Everest crawler (in development)	Everest-Vulcan Inc./0.1 (R&D project; http://everest.vulcan.com/crawlerhelp)
480	Exalead Websearch image crawler (193.47.80.xx)	Exabot-Images/1.0
481	Exalead (France) search robot (193.47.80.xx)	Exabot-Test/1.0
482	Exalead (France) search robot (193.47.80.xx)	Exabot/2.0
483	Exalead (France) search robot (193.47.80.xx)	Exabot/3.0
484	eXact Search Bar for IE	ExactSearch
485	ExactSEEK (Jayde Online) robot	ExactSeek Crawler/0.1
486	ExactSEEK (Jayde Online) robot	exactseek-crawler-2.63 (crawler@exactseek.com)
487	ExactSEEK (Jayde Online) robot	exactseek-pagereaper-2.63 (crawler@exactseek.com)
488	ExactSEEK (Jayde Online) robot (69.9.181.1xx)	exactseek.com
489	Exalead (France) search robot (193.47.80.xx)	Exalead NG/MimeLive Client (convert/http/0.120)
490	Excalibur (now Convera) spider software	Excalibur Internet Spider V6.5.4
491	Execrawl software search using nutch	Execrawl/1.0 (Execrawl; http://www.execrawl.com/; bot@execrawl.com)
492	exooba crawler for exooba search pre-alpha development	exooba crawler/exooba crawler (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com)
493	exooba crawler for exooba search pre-alpha development	exooba/exooba crawler (exooba; exooba)
494	Mirago UK Robot	ExperimentalHenrytheMiragoRobot
495	Expired Domain Sleuth domain name tool	Expired Domain Sleuth
496	Express Web Pictures image browser	Express WebPictures (www.express-soft.com)
497	Extractor Pro e-mail collector	ExtractorPro
498	Exisoftware image grabber and downloading tool	Extreme Picture Finder
499	Download-Tipp Germany robot	EyeCatcher (Download-tipp.de)/1.0
500	Factbites search robot	Factbot 1.09 (see http://www.factbites.com/webmasters.php)
501	Factbites search robot	factbot : http://www.factbites.com/robots
502	FaEdit Professional - Japanese bookmark manager	FaEdit/2.0.x
503	FairAd user	FairAd Client
504	Safe-t.net web filtering service	FANGCrawl/0.01
505	Drew Curtis' FARK.com link checking	FARK.com link verifier
506	Fast/Alltheweb crawler (66.151.181.xx)	Fast Crawler Gold Edition
507	Fast/Alltheweb crawler (66.151.181.xx)	FAST Enterprise Crawler 6 (Experimental)
508	Fast Enterprise Crawler (66.151.181.xx) for Scirus scienctific information search	FAST Enterprise Crawler 6 / Scirus scirus-crawler@fast.no; http://www.scirus.com/srsapp/contactus/
509	Fast/Alltheweb crawler (66.151.181.xx)	FAST Enterprise Crawler 6 used by Cobra Development (admin@fastsearch.com)
510	Comperio Web Miner based on Fast ESP	FAST Enterprise Crawler 6 used by Comperio AS (sts@comperio.no)
511	Fast/Alltheweb crawler (66.151.181.xx)	FAST Enterprise Crawler 6 used by FAST (FAST)
512	Pages Jaunes business search (France) robot using Fast Enterprise Crawler	FAST Enterprise Crawler 6 used by Pages Jaunes (pvincent@pagesjaunes.fr)
513	Fast/Alltheweb crawler for Sensis.com.au Australian search (66.151.181.xx)	FAST Enterprise Crawler 6 used by Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au)
514	SPH Search - Singapore related search using Fast crawler	FAST Enterprise Crawler 6 used by Singapore Press Holdings (crawler@sphsearch.sg)
515	FAST Enterprise Crawler used by WWU (University of Muenster - Germany)	FAST Enterprise Crawler 6 used by WWU (wardi@uni-muenster.de)
516	Fast/Alltheweb crawler (66.151.181.xx)	FAST Enterprise Crawler/6 (www.fastsearch.com)
517	Fast/Alltheweb crawler (66.151.181.xx)	FAST Enterprise Crawler/6.4 (helpdesk at fast.no)
518	Fast/Alltheweb crawler (66.151.181.xx)	FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0)
519	Fast/Alltheweb crawler (66.151.181.xx)	FAST MetaWeb Crawler (helpdesk at fastsearch dot com)
520	Fast/Alltheweb crawler (66.151.181.xx)	Fast PartnerSite Crawler
521	Fast/Alltheweb multimedia crawler	FAST-WebCrawler/2.2.10 (Multimedia Search) (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)
522	Fast/Alltheweb crawler	FAST-WebCrawler/2.2.6 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)
523	Fast/Alltheweb crawler	FAST-WebCrawler/2.2.7 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no
524	Fast/Alltheweb crawler	FAST-WebCrawler/2.2.8 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no
525	Fast/Alltheweb crawler	FAST-WebCrawler/3.2 test
526	Fast/Alltheweb crawler	FAST-WebCrawler/3.3 (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)
527	Fast/Alltheweb crawler	FAST-WebCrawler/3.4/Nirvana (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)
528	Fast/Alltheweb crawler	FAST-WebCrawler/3.4/PartnerSite (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)
529	Fast/Alltheweb crawler	FAST-WebCrawler/3.5 (atw-crawler at fast dot no; http://fast.no/support.php?c=faqs/crawler)
530	Fast/Alltheweb crawler	FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
531	Fast/Alltheweb crawler	FAST-WebCrawler/3.6/FirstPage (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)
532	Fast/Alltheweb crawler	FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
533	Fast/Alltheweb crawler	FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)
534	Fast/Alltheweb crawler	FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
535	Fast/Alltheweb crawler	FAST-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
536	Fast/Alltheweb multimedia crawler	FAST-WebCrawler/3.x Multimedia
537	Fast/Alltheweb multimedia crawler	FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)
538	Fastbot search Germany crawler (80.252.104.1xx)	fastbot crawler beta 2.0 (+http://www.fastbot.de)
539	Ay-Up geo sync search robot	FastBug http://www.ay-up.com
540	Fast/Alltheweb crawler (66.151.181.xx)	FastCrawler 3.0.1 (crawler@1klik.dk)
541	Fast/Alltheweb crawler used by SuperPages.com	FastSearch Web Crawler for Verizon SuperPages (kevin.watters@fastsearch.com)
542	Favcollector Favicon collecting robot	Favcollector/2.0 (info@favcollector.com http://www.favcollector.com/)
543	FavIconizer - IE favorites icons refreshing tool	FavIconizer
544	favo.eu (Germany) search robot	favo.eu crawler/0.6 (http://www.favo.eu)
545	ZD's FavOrg favourites managing program	FavOrg
546	Campulka.net Favorites checking tool	Favorites Checking (http://campulka.net)
547	Favorites Sweeper bookmark checker	Favorites Sweeper v.2.03
548	FaXo Search robot (69.152.89.xx)	Faxobot/1.0
549	Free Download Manager (FDM) download accelerator	FDM 1.x
550	Free Download Manager (FDM) download accelerator	FDM 2.x
551	RSS Feed Seeker bot (68.225.95.2xx)	Feed Seeker Bot (RSS Feed Seeker http://www.MyNewFavoriteThing.com/fsb.php)
552	Feed24 news feed and blog search	Feed24.com
553	Feed::Find - Syndication feed (RSS/Atom) auto-discovery	Feed::Find/0.0x
554	Feedable beta web based RSS service	Feedable/0.1 (compatible; MSIE 6.0; Windows NT 5.1)
555	Unknown robot from the University of Tokyo (157.82.157.xx)	FeedChecker/0.01
556	FeedDemon RSS reader	FeedDemon/2.7 (http://www.newsgator.com/; Microsoft Windows XP)
557	Google news feed feetcher for iGoogle gadgets	Feedfetcher-Google-iGoogleGadgets; (+http://www.google.com/feedfetcher.html)
558	Google Feedfetcher - RSS and Atom feed crawler	Feedfetcher-Google; (+http://www.google.com/feedfetcher.html)
559	FeedForAll RSS feed robot	FeedForAll rss2html.php v2
560	FeedHub news feed personalization engine powered by mSpoke	FeedHub FeedDiscovery/1.0 (http://www.feedhub.com)
561	FeedHub news feed personalization engine powered by mSpoke	FeedHub MetaDataFetcher/1.0 (http://www.feedhub.com)
562	Feedjit news feed service favicon crawler	Feedjit Favicon Crawler 1.0
563	Newsbrain Feedreader3	Feedreader 3.xx (Powered by Newsbrain)
564	FeedShow online RSS feed reader	Feedshow/x.0 (http://www.feedshow.com; 1 subscriber)
565	FeedShow online RSS feed reader	FeedshowOnline (http://www.feedshow.com)
566	FeedZcollector - Feed (RSS, ATOM and RDF) capturing software	FeedZcollector v1.x (Platinum) http://www.feeds4all.com/feedzcollector
567	MixCat robot	Felix - Mixcat Crawler (+http://mixcat.com)
568	FreeBSD download tool	fetch libfetch/2.0
569	Frequent Finders spider via Sitefusion.com	FFC Trap Door Spider
570	Filangy search and bookmark service	Filangy/0.01-beta (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com)
571	Filangy search and bookmark service	Filangy/1.0x (Filangy; http://www.filangy.com/filangyinfo.jsp?inc=robots.jsp; filangy-agent@filangy.com)
572	Filangy search and bookmark service	Filangy/1.0x (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com)
573	File Boost Network link checking	fileboost.net/1.0 (+http://www.fileboost.net)
574	FileHound download manager	FileHound x.x
575	filtrbox media content (news) monitoring	Filtrbox/1.0
576	Find An ISP robot	FindAnISP.com_ISP_Finder_v99a
577	Yelo.no business search (Norway) via Findexa	Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece)
578	NextLinks - German vocabulary and hyperlink search	findlinks/x.xxx (+http://wortschatz.uni-leipzig.de/findlinks/)
579	Finesearch robot	FineBot
580	Finjan Vital Security Web Appliance security solution	Finjan-prefetch
581	Fireball.de robot	Firefly/1.0
582	Fireball.de robot	Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5)
583	Unknown robot from Czech Technical University Prague (147.32.141.xx)	Firefox (kastaneta03@hotmail.com)
584	Unknown robot from Czech Technical University Prague (147.32.141.xx)	Firefox_1.0.6 (kasparek@naparek.cz)
585	AT&T/Fast Search robot for FirstGov (U.S.Government) portal	FirstGov.gov Search - POC:firstgov.webmasters@gsa.gov
586	Firstsfind Germany robot / link checking	firstsbot
587	Flaptor information retrieval solutions robot	Flapbot/0.7.2 (Flaptor Crawler; http://www.flaptor.com; crawler at flaptor period com)
588	JetCar/FlashGet download manager	FlashGet
589	FlatArts Favorites Icon Tool	FLATARTS_FAVICO
590	Flexum.ru search service	Flexum spider
591	Flexum.ru search service	Flexum/2.0
592	DivX.com Movie Find robot	FlickBot 2.0 RPT-HTTPClient/0.3-3
593	Metacarta / Cogent robot	flunky
594	unknown	fly/6.01 libwww/4.0D
595	FLY Index Metasearch link checking	flyindex.net 1.0/http://www.flyindex.net
596	Fnoole news crawler	FnooleBot/2.5.2 (+http://www.fnoole.com/addurl.html)
597	IBM's Almaden Research robot	FocusedSampler/1.0
598	folkd.com social search robot	Folkd.com Spider/0.1 beta 1 (www.folkd.com)
599	FollowSite robot - website monitoring	FollowSite Bot ( http://www.followsite.com/bot.html )
600	FollowSite robot - website monitoring	FollowSite.com ( http://www.followsite.com/b.html )
601	Fooky search Scorpionbots robot (65.12.170.xxx)	Fooky.com/ScorpionBot/ScoutOut; http://www.fooky.com/scorpionbots
602	Neomo Search (Germany) robot (85.10.197.1xx)	Francis/1.0 (francis@neomo.de http://www.neomo.de/)
603	Some spam bot	Franklin Locator 1.8
604	Free Downloads shareware directory link checking	free-downloads.net download-link validator /0.1
605	FreeFind.com robot	FreeFind.com-SiteSearchEngine/1.0 (http://freefind.com; spiderinfo@freefind.com)
606	Frelics backlink checking bot (beta)	Frelicbot/1.0 +http://www.frelic.com/
607	Fresh Download download manager	FreshDownload/x.xx
608	FreshNotes - music related artist search (72.3.225.xx)	FreshNotes crawler< report problems to crawler-at-freshnotes-dot-com
609	Some site scanning tool via diff. IPs	FSurf15a 01
610	Find the Best search robot	FTB-Bot http://www.findthebest.co.uk/
611	Some site scanning tool from diff. IPs i.e.: - 66.28.240.xx (cogentco.com) - 68.5.174.xx (cox.net)	Full Web Bot 0416B
612	Some site scanning tool i.e. from - 68.154.96.xx (bellsouth.net)	Full Web Bot 0516B
613	Some site scanning tool from 66.255.6.xxx (uslec.com)	Full Web Bot 2816B
614	FuseBulb search	FuseBulb.Com
615	FyberSearch FyberSpider robot	FyberSpider (+http://www.fybersearch.com/fyberspider.php)
616	Some user from bbnplanet.net (4.63.218.2xx) using an Innerprise robot tool	Gagglebot
617	Seed Search robot	GAIS Robot/1.0B2
618	Gaislab Taiwan robot	Gaisbot/3.0 (indexer@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php)
619	Gaislab Taiwan robot	Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)
620	Galaxy robot (63.121.41.xxx)	GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html)
621	Gallent Search directory (UK)	Gallent Search Spider v1.4 Robot 2 (http://robot.GallentSearch.com)
622	Gamekit game search engine - Germany	gamekitbot/1.0 (+http://www.uchoose.de/crawler/gamekitbot/)
623	GameSpyHTTP/1.0	Gamespy_Arcade
624	GammaWare GammaSpider	GammaSpider/1.0
625	nttrd.com / Infobee.ne.jp robot	gazz/x.x (gazz@nttrd.com)
626	Geckobot user robot	geckobot
627	Google Mobile Search crawler	Generic Mobile Phone (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
628	Unknown robot from Carnegie Mellon University (128.2.211.xxx)	generic_crawler/01.0217/
629	Lunascape Genesis browser	GenesisBrowser (HTTP 1.1; 0.9; XP SP2; .NET CLR 2.0.50727)
630	GenieKnows.com search	genieBot (http://64.5.245.11/faq/faq.html)
631	GenieKnows.com search	geniebot wgao@genieknows.com
632	Unknown robot from wavepath.com (65.254.33.1xx)	GeoBot/1.0
633	Geona Search robot / link checking	GeonaBot 1.x; http://www.geona.com/
634	GeoURL ICBM Address Server - a location-to-URL reverse directory	geourl/2.0b2
635	GeoURL ICBM Address Server - a location-to-URL reverse directory	GeoURLBot 1.0 (http://geourl.org)
636	Getbot web downloading tool / site grabber	GetBot
637	GetRight download manager	GetRight/3.x.x
638	GetRight download manager	GetRight/4.5xx
639	GetRight download manager	GetRight/4.x
640	GetRight download manager	GetRight/4.x[a-e]
641	GetRight download manager	GetRight/6.1 (Pro)
642	GetRight download manager	GetRightPro/6.0beta2
643	GetWeb - web page to email service	GetWeb/0.1 libwww-perl/5.16
644	Sixxs Ghost Route Hunter	GhostRouteHunter/20021130 (https://www.sixxs.net/tools/grh/; info@sixxs.net)
645	GigaBaz Brainbot (Germany) robot	gigabaz/3.1x (baz@gigabaz.com; http://gigabaz.com/gigabaz/)
646	Gigablast robot (64.62.168.xx)	Gigabot/2.0 (gigablast.com)
647	Gigablast robot	Gigabot/2.0/gigablast.com/spider.html
648	Gigablast robot	Gigabot/2.0; http://www.gigablast.com/spider.html
649	Gigablast robot	Gigabot/2.0att
650	Gigablast robot	Gigabot/3.0 (http://www.gigablast.com/spider.html)
651	Gigablast robot (64.62.168.xx)	Gigabot/x.0
652	Gigablast robot (64.62.168.xx)	GigabotSiteSearch/2.0 (sitesearch.gigablast.com)
653	www.gnod.net spider	GNODSPIDER (www.gnod.net)
654	Go!Zilla download manager	Go!Zilla 3.x (www.gozilla.com)
655	Go!Zilla download manager	Go!Zilla/4.x.x.xx
656	GotIt web accelerator (discontinued)	Go-Ahead-Got-It/1.1
657	GoGuides.Org (195.226.137.xx) robot	Goblin/0.9 (http://www.goguides.org/)
658	GoGuides.Org (195.226.137.xx) robot	Goblin/0.9.x (http://www.goguides.org/goblin-info.html)
659	GoForIt Search robot	GoForIt.com
660	GoForIt Search robot	GOFORITBOT ( http://www.goforit.com/about/ )
661	GoGuides.org directory & search link checking	GoGuides.Org Link Check
662	GoldenFeed.com - RSS search engine	GoldenFeed Spider 1.0 (http://www.goldenfeed.com)
663	Invention Machines Goldfire Server	Goldfire Server
664	suchen.de German local search robot	gonzo1[P] +http://www.suchen.de/popups/faq.jsp
665	suchen.de German local search robot	gonzo2[P] +http://www.suchen.de/faq.html
666	Some private robot (Wanadoo.fr client)	Goofer/0.2
667	Google instant messenger	Google Talk
668	Packard Bell Net user robot (*not* Google)	googlebot (larbin2.6.0@unspecified.mail)
669	Google image crawler (66.249.72.xxx)	Googlebot-Image/1.0
670	Google image crawler (66.249.72.xxx)	Googlebot-Image/1.0 ( http://www.googlebot.com/bot.html)
671	Google robot 66.249.64.XXX	Googlebot/2.1 ( http://www.google.com/bot.html)
672	Google robot 66.249.64.XXX	Googlebot/2.1 ( http://www.googlebot.com/bot.html)
673	Google robot 66.249.64.XXX	Googlebot/Test ( http://www.googlebot.com/bot.html)
674	ShareThis social networking service via Amazon Web Services	Gordon's Spider/Nutch-0.9 (http://www.sharethis.com; gordon@sharethis.com)
675	Grapeshot web search system API	GrapeFX/0.3 libwww/5.4.0
676	Flatland Industries vertical search solution	great-plains-web-spider/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatlandindustries.com)
677	GreatNews 1.0 Beta RSS reader	GreatNews/1.0
678	GreenBrowser - IE based browser (China)	GreenBrowser
679	search gridwell favicon display	gridwell (http://search.gridwell.com)
680	Grigor Search bot	GrigorBot 0.8 (http://www.grigor.biz/bot.html)
681	Australasian Legal Information Institute (AustLII) robot	Gromit/1.0
682	Grub open source crawler	grub crawler(http://www.grub.org)
683	Grub open source crawler	grub-client
684	Google Search Appliance robot (216.239.xx.xx)	gsa-crawler (Enterprise; GID-01422; jplastiras@google.com)
685	Google Search Appliance robot (216.239.xx.xx)	gsa-crawler (Enterprise; GID-01742;gsatesting@rediffmail.com)
686	Google Enterprise Search Appliance used by Enhesa (212.35.100.1xx)	gsa-crawler (Enterprise; GIX-02057; dm@enhesa.com)
687	Google Enterprise Search Appliance used by IBM (129.41.20.1xx)	gsa-crawler (Enterprise; GIX-03519; cknuetter@stubhub.com)
688	Google Search Appliance robot (216.239.xx.xx)	gsa-crawler (Enterprise; GIX-0xxxx; enterprise-training@google.com)
689	GSiteCrawler - Google sitemap generator for Windows	GSiteCrawler/v1.xx rev. xxx (http://gsitecrawler.com/)
690	Guestbook spamming tool	Guestbook Auto Submitter
691	Northernlight robot	Gulliver/1.3
692	Yuntis Collaborative Web Resource Categorization and Ranking Project robot	Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)
693	Gungho - Extensible web crawler written in Perl by Google Code	Gungho/0.08004 (http://code.google.com/p/gungho-crawler/wiki/Index)
694	guruji : the Indian search engine robot	GurujiBot/1.0 (+http://www.guruji.com/WebmasterFAQ.html)
695	guruji : the Indian search engine picture crawler	GurujiImageBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html)
696	Openwave Mobile Browser on Haier T10C mobile	Haier-T10C/1.0 iPanel/2.0 WAP2.0 (compatible; UP.Browser/6.2.2.4; UPG1; UP/4.0; Embedded)
697	Happy Fun Search robot	HappyFunBot/1.1
698	Harvest-NG web crawler used by search.yahoo.com	Harvest-NG/1.0.2
699	Haste - web mapping and monitoring system	Haste/0.12 (HOME: http://haste.kytoon.com/)
700	Hatena::Antenna Japan robot	Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot)
701	Hatena Japan proxy for handheld/mobile clients	Hatena Mobile Gateway/1.0
702	Hatena Japan robot	Hatena Pagetitle Agent/1.0
703	Hatena Japan RSS feed robot	Hatena RSS/0.3 (http://r.hatena.ne.jp)
704	Hatena::Diary (Japan) web page screenshot robot	HatenaScreenshot/1.0 (checker)
705	hbtronix.spider - Domain name spider (Germany)	hbtronix.spider.2 -- http://hbtronix.de/spider.php
706	Mirago Germany robot	HeinrichderMiragoRobot
707	Mirago Germany robot	HeinrichderMiragoRobot (http://www.miragorobot.com/scripts/deinfo.asp)
708	Helix - The SiteSearch (Canada) web crawler	Helix/1.x ( http://www.sitesearch.ca/helix/)
709	Mirago France robot	HenriLeRobotMirago (http://www.miragorobot.com/scripts/frinfo.asp)
710	Mirago search (UK) robot	HenrytheMiragoRobot
711	Mirago search (UK) robot	HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)
712	O'Reilly's Perl LWP example client program from Web Client Programming with Perl	hgrepurl/1.0
713	University of Kassel Germany CsCrawler using the HTTPClient library	Hi! I'm CsCrawler my homepage: http://www.kde.cs.uni-kassel.de/lehre/ss2005/googlespam/crawler.html RPT-HTTPClient/0.3-3
714	HiDownload download manager	HiDownload
715	Hippias robot	Hippias/0.9 Beta
716	Pilot Hitlist web analytics solution	HitList
717	Hitwise spider	Hitwise Spider v1.0 http://www.hitwise.com
718	diff. IPs / unknown services	HLoader
719	Morfeo / Centrum Search (Czech Republic) robot from 65.102.46.xxx	holmes/3.11 (http://morfeo.centrum.cz/bot)
720	Onet.pl (Poland) search robot	holmes/3.9 (onet.pl)
721	Onet.pl (Poland) search robot	holmes/3.xx (OnetSzukaj/5.0; +http://szukaj.onet.pl)
722	Morfeo / Centrum Search (Czech Republic) robot from 65.102.46.xxx	holmes/x.x
723	Holes search robot (Georgia)	HolmesBot (http://holmes.ge)
724	HomePageSearch robot	HomePageSearch(hpsearch.uni-trier.de)
725	Homerweb search robot	Homerbot: www.homerweb.com
726	Honda-Search.com - Honda cars related search robot	Honda-Search/0.7.2 (Nutch; http://lucene.apache.org/nutch/bot.html; search@honda-search.com)
727	HooWWer - Next Generation Information Retrieval robot	HooWWWer/2.1.3 (debugging run) (+http://cosco.hiit.fi/search/hoowwwer/ | mailto:crawler-info<at>hiit.fi)
728	HooWWer - Next Generation Information Retrieval robot (128.214.112.xx)	HooWWWer/2.1.x ( http://cosco.hiit.fi/search/hoowwwer/ | mailto:crawler-info<at>hiit.fi)
729	HotJava browser plus HTML Component 1.1.x	HotJava/1.0.1/JRE1.1.x
730	Hotzuno - Japanese BBS reader client	Hotzonu/x.0
731	Unknown robot from HP Labs	HPL/Nutch-0.9 -
732	COMPUTERorgs.com robot (205.134.190.xxx) using htdig	htdig/3.1.6 (http://computerorgs.com)
733	htdig used by the Academie de Toulouse	htdig/3.1.6 (unconfigured@htdig.searchengine.maintainer)
734	htdig search tool	htdig/3.1.x (root@localhost)
735	Lithops Software link validation tool	Html Link Validator (www.lithopssoft.com)
736	HTML2JPG webpage to image converter	HTML2JPG Blackbox, http://www.html2jpg.com
737	HTML2JPG webpage to image converter	HTML2JPG Enterprise
738	HTML Parser Java library to parse HTML	HTMLParser/1.x
739	PHP HTTP client to access Web servers	HTTP Retriever
740	Anonymous web proxy service	http://Anonymouse.org/ (Unix)
741	Ask 24x Info (Germany) DMOZ related robot	http://Ask.24x.Info/ (http://narres.it/)
742	ACONTBOT - Acont search Germany robot	http://hilfe.acont.de/bot.html ACONTBOT
743	OzySoftware.com software directory link checking	http://OzySoftware.com/Index.html
744	IBM's Almaden Research robot	http://www.almaden.ibm.com/cs/crawler
745	IBM's Almaden Research robot	http://www.almaden.ibm.com/cs/crawler [rc1.wf.ibm.com]
746	IBM's Almaden Research robot	http://www.almaden.ibm.com/cs/crawler [wf216]
747	Istarthere.com search robot	http://www.istarthere.com_spider@istarthere.com
748	Monogol - German open source search engine project (195.226.167.1xx)	http://www.monogol.de
749	TrendTech Search Engine (Denmark) robot	http://www.trendtech.dk/spider.asp)
750	HTTP::Lite - Standalone Perl module for retreiving HTTP documents	HTTP::Lite/2.x.x
751	HTTPEyes - Web proxy cache	HTTPEyes
752	HTTPResume Amiga download manager	HTTPResume v. 1.x
753	HttpUnit - Java test code for emulating browser behaviour	httpunit/1.5
754	HttpUnit - Java browser behavior simulation tool	httpunit/1.x
755	Hybrid Share mono C#/Gtk# application for file sharing	Hybrid/1.2 [en] (OS Independent)
756	Hyper Estraier full-text search system	HyperEstraier/1.x.xx
757	i1search robot	i1searchbot/2.0 (i1search web crawler; http://www.i1search.com; crawler@i1search.com)
758	Alexa / The Internet Archive (209.237.238.1xx)	IAArchiver-1.0
759	Unknown robot (reads robots.txt) from chinatelecom (219.142.78.xx)	iaskspider
760	Iask search / Sina portal robot (China)	iaskspider2 (iask@staff.sina.com.cn)
761	Alexa / The Internet Archive (209.237.238.1xx)	ia_archiver
762	Alexa / The Internet Archive (209.237.238.1xx)	ia_archiver-web.archive.org
763	Alexa / The Internet Archive (209.237.238.1xx)	ia_archiver/1.6
764	IOSpirit iBrowse Amiga Browser	IBrowse/2.2 (AmigaOS 3.5)
765	IOSpirit iBrowse Amiga Browser	IBrowse/2.2 (Windows 3.1)
766	iCab MAC Web browser	iCab/2.5.2 (Macintosh; I; PPC)
767	Knowledge Clustered Group ICC-Crawler (University of Tokyo - Japan)	ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html; icc-crawl(at)ml(dot)nict(dot)go(dot)jp)
768	Knowledge Clustered Group ICC-Crawler (University of Tokyo - Japan)	ICC-Crawler(Mozilla-compatible;http://kc.nict.go.jp/icc/crawl.html;icc-crawl-contact(at)ml(dot)nict(dot)go(dot)jp)
769	ICJobs - Intelligence Competence Center (Germany) robot	iCCrawler (http://www.iccenter.net)
770	ICJobs - Intelligence Competence Center (Germany) robot	ICCrawler - ICjobs (http://www.icjobs.de/bot.htm)
771	ICE Java browser	ICE Browser/5.05 (Java 1.4.0; Windows 2000 5.0 x86)
772	Goo Japan / Inktomi robot (210.173.179.xx)	ichiro/x.0 (http://help.goo.ne.jp/door/crawler.html)
773	Goo Japan / Inktomi robot (210.173.179.xx)	ichiro/x.0 (ichiro@nttr.co.jp)
774	Iconsurf.com - Visual Surf Engine / favicon finder	IconSurf/2.0 favicon finder (see http://iconsurf.com/robot.html)
775	Iconsurf.com - Visual Surf Engine / favicon finder	IconSurf/2.0 favicon monitor (see http://iconsurf.com/robot.html)
776	icooLoader download manager	ICOO Loader v.x.x.x
777	ICRA (Internet Content Rating Association) label spider	ICRA_label_spider/x.0
778	ICS Robot Search Engine (International Christian school of Seoul)	icsbot-0.1
779	Internet Download Accelerator	IDA
780	Janas (Ideare.com / Tiscali.it) robot	ideare - SignSite/1.x
781	Unknown UA from Yahoo China	iearthworm/1.0, iearthworm@yahoo.com.cn
782	Some bookmark manager	IEFav172Free
783	iFeed.jp - online rss aggregator (in development)	iFeed.jp/2.0 (www.psychedelix.com/agents/agents.rss; 0 subscribers)
784	Igde search (Russia) robot	igdeSpyder (compatible; igde.ru; +http://igde.ru/doc/tech.html)
785	iGetter download manager	iGetter/1.x (Macintosh;G;PPC)
786	iGetter download manager	iGetter/2 (Macintosh; U; PPC Mac OS X; en)
787	Webkhoj - Indian language search engine	IIITBOT/1.1 (Indian Language Web Search Engine; http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in)
788	Ilial Knowledge Search robot	ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup company. For more information please visit http://www.ilial.com/crawler; http://www.ilial.com/crawler; crawl@ilial.com)
789	Unknown robot from UCLA using Nutch	ilial/Nutch-0.9-dev
790	Ilse Netherlands robot (62.69.178.xx)	IlseBot/1.x
791	Il Trovatore - Italian search engine robot	IlTrovatore-Setaccio ( http://www.iltrovatore.it)
792	Il Trovatore - Italian search engine robot	Iltrovatore-Setaccio/0.3-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
793	Il Trovatore - Italian search engine robot	IlTrovatore-Setaccio/1.2 ( http://www.iltrovatore.it/aiuto/faq.html)
794	Il Trovatore - Italian search engine robot	Iltrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
795	Il Trovatore - Italian search engine robot	iltrovatore-setaccio/1.2-dev (spidering; http://www.iltrovatore.it/aiuto/.....)
796	Il Trovatore - Italian search engine robot	IlTrovatore/1.2 (IlTrovatore; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it)
797	ImageVisu image and graphics viewer - display files from the Web (HTTP and ECWP)	ImageVisu/v4.x.x
798	BD-Brandprotect copyright infringement crawler	ImageWalker/2.0 (www.bdbrandprotect.com)
799	HttpClient - a PHP Web Client Class	Incutio HttpClient v0.x
800	IncyWincy search engine using DMOZ Open Directory database	IncyWincy data gatherer(webmaster@loopimprovements.com
801	IncyWincy search engine using DMOZ Open Directory database	IncyWincy page crawler(webmaster@loopimprovements.com
802	Look.com robot using IncyWincy search engine	IncyWincy(http://www.look.com)
803	IncyWincy search engine using DMOZ Open Directory database	IncyWincy(http://www.loopimprovements.com/robot.html)
804	IncyWincy search engine using DMOZ Open Directory database	IncyWincy/2.1(loopimprovements.com/robot.html)
805	Index the Web (69.57.134.xx) crawler	IndexTheWeb.com Crawler7
806	Spam bot from diff. IPs	Industry Program 1.0.x
807	Inet Library Resource Center robot	Inet library
808	InetURL IVM (phone software) plugin for web server access ?	InetURL/1.0
809	Pubblisito.com search - Italia	info@pubblisito.com- (http://www.pubblisito.com) il Sud dei Motori di Ricerca
810	Infoaxe - search history and bookmark service	Infoaxe./Nutch-0.9
811	Converas RetrievalWare Internet Spider (63.241.61.x)	infoConveraCrawler/0.8 ( http://www.authoritativeweb.com/crawl)
812	Versions-project.org Ingelin spider	InfoFly/1.0 (http://www.versions-project.org/)
813	InfoLink link checking tool	InfoLink/1.x
814	INFOMINE Scholary Internet Resource Collection crawler	INFOMINE/8.0 Adders
815	INFOMINE Scholary Internet Resource Collection crawler	INFOMINE/8.0 RemoteServices
816	INFOMINE Scholary Internet Resource Collection crawler	INFOMINE/8.0 VLCrawler (http://infomine.ucr.edu/useragents)
817	164.71.1.1xx jp.co.fujitsu.t2 Robot	InfoNaviRobot(F107)
818	Infoseek robot	InfoSeek Sidewinder/0.9
819	Infoseek robot	InfoSeek Sidewinder/1.0A
820	Infoseek robot	InfoSeek Sidewinder/1.1A
821	Infoseek robot	Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX)
822	Infoseek Japan robot	Infoseek SideWinder/2.0B (Linux 2.4 i686)
823	Ilse Netherlands robot (62.69.178.xx)	INGRID/3.0 MT (webcrawler@NOSPAMexperimental.net; http://webmaster.ilse.nl/jsp/webmaster.jsp)
824	Inktomi (Hotbot-Lycos NBCi etc.) robot	Inktomi Search
825	Enterprise Search engine software (64.202.165.xxx)	InnerpriseBot/1.0 (http://www.innerprise.com/)
826	Insitor Search robot (80.67.20.1xx)	Insitor.com search and find world wide!
827	Insitor Search robot (80.67.20.1xx)	Insitornaut
828	download manager	InstallShield DigitalWizard
829	Integrity - website broken link checker for MAC OSx	integrity/1.6
830	Microton Intelix robot for Eurotran translation software ?	Intelix/0.x (cs; http://www.microton.cz/intelix/; microton@@microton.cz)
831	Interarchy file transfer software - SFTP/FTP client for Mac OS X	Interarchy/x.x.x (InterarchyCrawler)
832	Dream Train (Japan) Internet search robot	Internet Ninja x.0
833	Heritrix - The Internet Archive's open-source crawler based on Nutch (207.241.225.2xx)	InternetArchive/0.8-dev(Nutch;http://lucene.apache.org/nutch/bot.html;nutch-agent@lucene.apache
834	Internet Link Agent - link checking tool	InternetLinkAgent/3.1
835	Internetseer Web site monitoring / Claymont robot	InternetSeer.com
836	intraVNews - Feed reader & RSS aggregator for Outlook	intraVnews/1.x
837	Internet Open Index crawler using Nutch	IOI/2.0 (ISC Open Index crawler; http://index.isc.org/; bot@index.isc.org)
838	IP*Works! HTTP Component	IP*Works! V5 HTTP/S Component - by /n software - www.nsoftware.com
839	IP2Location - Reverse lookup geographical data and ISP by IP	http://www.ip2location.com
840	IP2Map - geographical IP mapping	IP2MapBot/1.1 <a href=http://www.ip2map.com>http://www.ip2map.com</a>
841	Laurions Ipium robot	IPiumBot laurion(dot)com
842	Ipselon Web Search robot	IpselonBot/0.xx-beta (Ipselon; http://www.ipselon.com; ipselonbot@ipselon.com)
843	Iria download manager	Iria/1.xxa
844	IRL-crawler - Texas A&M University research project crawler	IRLbot/1.0 ( http://irl.cs.tamu.edu/crawler)
845	IRL-crawler - Texas A&M University research project crawler	IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler/)
846	url_log - Irssi Perl url grabber	IrssiUrlLog/0.2
847	Irvine downloading tool	Irvine/1.x.x
848	Unknown spambot / harvester from diff. IPs	ISC Systems iRc Search 2.1
849	iSiloX document converter for iSilo reader	iSiloX/4.xx Windows/32
850	Unknown University of Alberta link-checking ?	isurf (tszhu@canada.com)
851	iTunes UA name for access and decrypt the iTunes music store pages	iTunes/x.x.x
852	Some spam bot from 66.139.78.xx(x)	IUPUI Research Bot v 1.9a
853	iVia robot - Open source Internet portal & virtual library system software	iVia Page Fetcher (http://ivia.ucr.edu/useragents.shtml)
854	iVia robot - Open source Internet portal & virtual library system software	iVia/4.0 CanonizeUrl (http://infomine.ucr.edu/iVia/useragents.shtml
855	BD BrandProtect - brand, company or trademarks online monitoring	IWAgent/ 1.0 - www.brandprotect.com
856	Proxy message from jp-q.ne.jp	J-PHONE/3.0/J-SH07
857	ODIN Directory Japan robot (163.138.95.xx)	Jabot/6.x (http://odin.ingrid.org/)
858	ODIN Directory Japan robot (163.138.95.xx)	Jabot/7.x.x (http://odin.ingrid.org/)
859	German Domanova (offline since Feb.02) robot	Jack
860	Jakarta Commons (Java based) HTTP client	Jakarta Commons-HttpClient/2.0xxx
861	Jakarta Commons (Java based) HTTP client	Jakarta Commons-HttpClient/3.0-rcx
862	JamBot search robot (70.146.82.xx)	Jambot/0.1.x (Jambot; http://www.jambot.com/blog; crawler@jambot.com)
863	JamBot search robot	Jambot/0.2.1 (Jambot; http://www.jambot.com/blog/static.php?page=webmaster-robot; crawler@jambot.com)
864	Java VM	Java 1.1
865	Java VM	Java/1.4.1_01
866	Java VM	Java1.0.21.0
867	Java VM	Java1.1.xx.x
868	Java VM	Java1.3.0rc1
869	Java VM	Java1.3.x
870	Java VM	Java1.4.0
871	Jayde B2B Search robot (66.28.139.xx)	Jayde Crawler. http://www.jayde.com
872	some site downloading tool ? via 61.77.51.xxx	JBH Agent 2.0
873	WAP 2.0 / jBrowser for handhelds	jBrowser/J2ME Profile/MIDP-1.0 Configuration/CLDC-1.0 (Google WAP Proxy/1.0)
874	JCheckLinks Java hyperlink validator	JCheckLinks/0.1 RPT-HTTPClient/0.3-1
875	Java Development Kit	JDK/1.1
876	Insignias Jeode (PDA) Java platform	Jeode/1.x.x
877	JetEye Search robot (64.62.142.xxx / 64.71.144.xxx)	Jetbot/1.0
878	Omea RSS - Atom - newsgroups web page reader	JetBrains Omea Reader 1.0.x (http://www.jetbrains.com/omea_reader/)
879	Omea RSS - Atom - newsgroups web page reader	JetBrains Omea Reader 2.0 Release Candidate 1 (http://www.jetbrains.com/omea_reader/)
880	JetCar / Flashget download manager	JetCar
881	Jigsaw - W3C's CSS Validator Server	Jigsaw/2.2.x W3C_CSS_Validator_JFouffa/2.0
882	Jobo website downloading program	JoBo/1.x (http://www.matuschek.net/jobo.html)
883	Jobo website downloading program	JoBo/@JOBO_VERSION@(http://www.matuschek.net/jobo.html)
884	Finacialbot.com - German (213.61.218.xx) job search JobRoboter	JobSpider_BA/1.1
885	Jocsoft Web Spider - website downloading tool	JOC Web Spider
886	Jordo Media RSS / Atom feed directory link checking	JordoMedia/1.0 RSS File Reader (http://www.jordomedia.com)
887	Journster.com RSS/Atom aggregator	Journster [alpha] (http://journster.com/)
888	Journster.com RSS/Atom aggregator	Journster.com RSS/Atom aggregator 0.5 (http://www.journster.com/bot.phtml)
889	Check Favorites bookmark checking	JRTS Check Favorites Utility
890	Check Favorites bookmark checking	JRTwine Software Check Favorites Utility
891	Jyxo search (Czech Republic) robot (212.71.128.xx)	Jyxobot/x
892	K-meleon browser - Windows 2000	K-Meleon/0.6 (Windows; U; Windows NT 5.1; en-US; rv:0.9.5) Gecko/20011011
893	Verity K2 Spider ( Network search software)	k2spider
894	Unknown robot from AITrc (Advanced Information Technology Research Center) - Korea	KAIST AITrc Crawler
895	Kakle ranked metasearch robot	KakleBot - www.kakle.com/0.1 (KakleBot - www.kakle.com; http:// www.kakle.com/bot.html; support@kakle.com)
896	Kalooga image crawler	kalooga/kalooga-4.0-dev-datahouse (Kalooga; http://www.kalooga.com; info@kalooga.com)
897	Kalooga image crawler	kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler; crawler@kalooga.com)
898	Kapere site grapper / web downloader	Kapere (http://www.kapere.com)
899	Kazehakase - Gecko based browser (Japan)	Kazehakase/0.x.x.[x]
900	Openwave UP.Browser for mobiles via Google WAP Proxy (216.239.33.x)	KDDI-SN22 UP.Browser/6.0.7 (GUI) MMP/1.1 (Google WAP Proxy/1.0)
901	Kenjin Spider search agent	Kenjin Spider
902	Dznet.com Kevin crawler (link checking ?) via 68.39.148.xx (nj.comcast.net)	Kevin http://dznet.com/kevin/
903	Website AlertsKevin crawler (website monitoring) via 68.39.148.xx (nj.comcast.net)	Kevin http://websitealert.net/kevin/
904	Voila.fr robot	KE_1.0/2.0 libwww/5.2.8
905	Some Perl search script from KFSW (Germany)	KFSW-Bot (Version: 1.01 powered by KFSW www.kfsw.de)
906	kinja weblog search robot	kinja-imagebot (http://www.kinja.com/)
907	kinja weblog search robot	kinjabot (http://www.kinja.com)
908	Fireball search (Germany) robot	KIT-Fireball/2.0
909	Fireball search (Germany) robot	KIT-Fireball/2.0 (compatible; Mozilla 4.0; MSIE 5.5)
910	Klondike WAP Browser	Klondike/1.50 (WSP Win32) (Google WAP Proxy/1.0)
911	University of Washington KnowItAll - web information extraction	KnowItAll(knowitall@cs.washington.edu)
912	The knowledge.com (ODP) directory robot	Knowledge.com/0.x
913	Kontiki Client download manager	Kontiki Client x.xx
914	Krugle source code search engine for developers (64.71.164.1xx)	Krugle/Krugle,Nutch/0.8+ (Krugle web crawler; http://www.krugle.com/crawler/info.html; webcrawler@krugle.com)
915	KnowledgeStorm technology industry crawler for Findtech.com	KSbot/1.0 (KnowledgeStorm crawler; http://www.knowledgestorm.com/resources/content/crawler/index.html; crawleradmin@knowledgestorm.com)
916	Kuloko contextual search robot	kuloko-bot/0.x
917	Kuloko contextual search robot	kulokobot www.kuloko.com kuloko@backweave.com
918	National Library of Sweden Heritage Project robot	kulturarw3/0.1
919	Link or server checking from Sanoma Budapest (195.70.35.xxx)	KummHttp/1.1 (compatible; KummClient; Linux rulez)
920	UP.Browser for mobiles on Kyocera KWC-KX9 cellphone	KWC-KX9/1109 UP.Browser/6.2.3.9.g.1.107 (GUI) MMP/2.0 UP.Link/6.3.0.0.0
921	TREC Blog Track - Blog and news feed crawler	Labrador/0.2; http://ir.dcs.gla.ac.uk/labrador; craigm@dcs.gla.ac.uk
922	Intels Lachesis web site response time monitoring tool	Lachesis
923	Unknown robot from Easten Network China (202.96.51.1xx)	lanshanbot/1.0
924	Unknown robot from Easten Network China (202.96.51.1xx)	lanshanbot/1.0 (+http://search.msn.com/msnbot.htm)
925	Lapozz search (Hungary) robot (82.131.195.xx)	LapozzBot/1.4 ( http://robot.lapozz.com)
926	Lapozz search (Hungary) robot (82.131.195.xx)	LapozzBot/1.5 (+http://robot.lapozz.hu)
927	Larbin indexer used as Metacarta.com (66.28.xx.xxx) robot	larbin (samualt9@bigfoot.com)
928	Unknown robot from 66.230.140.xx (argon.oxeo.com)	LARBIN-EXPERIMENTAL (efp@gmx.net)
929	Larbin indexer used by Mitsubishi Electric Research Labs	larbin_2.1.1 larbin2.1.1@somewhere.com
930	Larbin indexer used as Compete.com crawler	larbin_2.2.0 (crawl@compete.com)
931	Larbin indexer used as Inria robot	larbin_2.2.1_de_Viennot (Laurent.Viennot@inria.fr)
932	Larbin indexer used as Kyoto University robot	larbin_2.2.2 (sugayama@lab7.kuis.kyoto-u.ac.jp)
933	Larbin indexer used as Inria robot	larbin_2.2.2_guillaume (guillaume@liafa.jussieu.fr)
934	Larbin indexer used by an unknown dsl.net client	larbin_2.6.0 (larbin2.6.0@unspecified.mail)
935	Larbin indexer used by diff. IPs / services	larbin_2.6.1 (larbin2.6.1@unspecified.mail)
936	Larbin indexer used by National Institut of Informatics (NII/Japan)	larbin_2.6.2 (hamasaki@grad.nii.ac.jp)
937	Larbin indexer used by diff. IPs	larbin_2.6.2 (larbin2.6.2@unspecified.mail)
938	Larbin indexer used as robot by Georgia Institute of Technology http://www.gatech.edu/	larbin_2.6.2 (listonATccDOTgatechDOTedu)
939	Larbin indexer used by Technical University of Crete	larbin_2.6.2 (pimenas@systems.tuc.gr)
940	Larbin indexer used as Lemur Consulting robot	larbin_2.6.2 (tom@lemurconsulting.com)
941	Larbin indexer used as robot via cloud9.net (168.100.192.xxx)	larbin_2.6.2 (vitalbox1@hotmail.com)
942	Unknown robot from EPFL Lausanne Switzerland (128.178.155.1xx)	larbin_2.6.3 (ltaa_web_crawler@groupes.epfl.ch)
943	Larbin indexer used by GenieKnows.com search	larbin_2.6.3 (wgao@genieknows.com)
944	Larbin indexer used by Next Generation Information Retrieval (NGIR)	larbin_2.6.3_for_(http://cosco.hiit.fi/search/) tsilande@hiit.fi
945	Larbin indexer used by CEA / DCom Rechercher	larbin_2.6_basileocaml (basile.starynkevitch@cea.fr)
946	Larbin indexer used as Inria robot	larbin_devel (http://pauillac.inria.fr/~ailleret/prog/larbin/)
947	LawInfo - Lawyer and attorney directory	lawinfo-crawler/Nutch-0.9-dev (Crawler for lawinfo.com pages; http://www.lawinfo.com; webmaster@lawinfo.com)
948	ROADS - Perl web based subject based gateway tool	lc/$ROADS::Version libwww-perl/5.00
949	unknown robot via MTT.ca / Aliant.ca	lcabotAccept: */*
950	LeapTag news reader and content discovery tool	LeapTag/0.8.1.beta081.r3750 (compatible; Mozilla 4.0; MSIE 5.5; robot@yoriwa.com)
951	Linkexchange crawler	LECodeChecker/3.0 libgetdoc/1.0
952	Leechget download manager	LeechGet 200x (www.leechget.de)
953	Gseek.com (site is offline) robot	LEIA/2.90
954	Gseek.com (site is offline) robot	LEIA/3.01pr (LEIAcrawler; [SNIP])
955	Maybe logfile spamming for Lets crawl! search (Germany)	LetsCrawl.com/1.0 +http://letscrawl.com/
956	Lexibot (exMataHari) search software	LexiBot/1.00
957	Polaris mobile browser on LG LX 260 Sprint Rumor phone	LG-LX260 POLARIS-LX260/2.0 MMP/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1
958	LG 8138 Mobile Phone browser	LG/U8138/v1.0
959	About.com robot	Libby_1.1/libwww-perl/5.47
960	libcurl's (multiprotocol file transfer library) standard user-agent name	libcurl-agent/1.0
961	LibertyW search for mobile (France)	LibertyW (+http://www.lw01.com)
962	Korea Telecom Search robot	libWeb/clsHTTP -- hiongun@kt.co.kr
963	CMP United Media robot	libwww-perl/5.41
964	SplatSearch robot (207.44.142.xx)	libwww-perl/5.45
965	Alexa robot	libwww-perl/5.48
966	diff. IPs / services	libwww-perl/5.50
967	Fast Search robot	libwww-perl/5.52 FP/2.1
968	Fast Search robot	libwww-perl/5.52 FP/4.0
969	diff. IPs / services	libwww-perl/5.53
970	Profile for You internet profiling (?)	libwww-perl/5.63
971	unknown link checking from Wanadoo.fr (193.253.33.xxx)	libwww-perl/5.64
972	Amidalla search engine robot (62.241.33.xx)	libwww-perl/5.65
973	SplatSearch robot (72.36.210.xx)	libwww-perl/5.800
974	Mediater Rechercher robot	libwww/5.3.2
975	Liferea - Linux feed reader	Liferea/0.x.x (Linux; en_US.UTF-8; http://liferea.sf.net/)
976	Liferea (Linux Feed Reader) news aggregator for Unix and Linux	Liferea/1.x.x (Linux; es_ES.UTF-8; http://liferea.sf.net/)
977	Lightning Download manager	LightningDownload/1.0beta2
978	Lightning Download manager	LightningDownload/1.x.x
979	Lightning Download manager	LightningDownload/1.x.x [Accelerated x]
980	Lijit blog search spider	LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com)
981	Some spam bot	Lincoln State Web Browser
982	Link Valet online link checking	Link Valet Online 1.x
983	Linkalarm link validation	LinkAlarm/2.x
984	Linkbot Pro link checking software	Linkbot
985	Rpsoft 2000 Site-Crawler	linkbot
986	Linkbot Pro link checking software	Linkbot x.0
987	Linkcheck - linkchecking tool for Unix/Linux	LinkCheck (linkcheck@inter7.com http://www.inter7.com/linkcheck)
988	Linklint - Perl html link checker	LinkLint-checkonly/2.x.x
989	Linklint - Perl html link checker	LinkLint-spider/2.x.x
990	Linknz - The Kiwi Search Engine (New Zealand)	linknzbot
991	Link-Pimp web directory link checking	LinkPimpin v1.0
992	TafWeb link checking program	LinkProver 2.1
993	Links text browser for Unix & OS/2	Links (0.9x; Linux 2.4.7-10 i686)
994	Links text browser for Unix & OS/2	Links (0.9xpre12; Linux 2.2.14-5.0 i686; 80x24)
995	Links text browser for Unix & OS/2	Links (2.xpre7; Linux 2.4.18 i586; x)
996	Links SQL directory management program	Links - http://gossamer-threads.com/scripts/links/
997	Links SQL directory management program	Links 2.0 (http://gossamer-threads.com/scripts/links/)
998	Links SQL directory management program	Links SQL (http://gossamer-threads.com/scripts/links-sql/)
999	Links4us ODP based directory link checking	Links4US-Crawler, (+http://links4us.com/)
1000	Shareware robot from Elsop.com (used by Indiafocus/Indiainfo and others)	LinkScan/11.0beta2 UnixShareware robot from Elsop.com (used by Indiafocus/Indiainfo)
1001	Shareware robot from Elsop.com (used by Indiafocus/Indiainfo and others)	LinkScan/9.0g Unix
1002	Shareware robot from Elsop.com	LinkScan/x.x Unix
1003	Linksmanager bookmark checking	LinksManager.com (http://linksmanager.com/linkchecker.html)
1004	LinkSonar (Japan) link checking tool	LinkSonar/1.35
1005	Left Side Software's LinkSweeper (ceased) bookmark utility	LinkSweeper/1.x
1006	Seventwentyfour link checking robot	LinkWalker
1007	link check 3 - Perl HTML link checker (from Perl for Web Site Management)	link_check3.plx libwww-perl/5.65
1008	Listbid.com / Directnic.com link checking ?	ListBidBot (freelance job spider http://listbid.com)<a href=http://listbid.com>Freelance</a>
1009	WKD Lab: LiveTrans - Online query and terminology translation service	LiveTrans/Nutch-0.9 (maintainer: cobain at iis dot sinica dot edu dot tw; http://wkd.iis.sinica.edu.tw/LiveTrans/)
1010	llaut robot - Universitat de les Illes Balears (Spain)	Llaut/1.0 (http://mnm.uib.es/~gallir/llaut/bot.html)
1011	E-Mail harvesting robot - same as ContactBot	LMQueueBot/0.2
1012	lmspider from Scansoft (192.133.61.xx) - Web text collector	lmspider (lmspider@scansoft.com)
1013	Lexis-Nexis robot	LNSpiderguy
1014	LocalBot company information collector	LocalBot/1.0 ( http://www.localbot.co.uk/)
1015	Local.com local search robot (216.52.252.xxx)	LocalcomBot/1.2.x ( http://www.local.com/bot.htm)
1016	Lockstep (website content protection tool) user agent	Lockstep Spider/1.0
1017	GlobalQueue spider (64.40.105.xxx)	Look.com
1018	Lotus Notes browser	Lotus-Notes/4.5 ( Windows-NT )
1019	IBM Lotus Discovery Server	LotusDiscovery/x.0 (compatible; Mozilla 4.0; MSIE 4.01; Windows NT)
1020	Everatom.com song lyrics search	Lovel as 1.0 ( +http://www.everatom.com)
1021	LTI - The Lemur Toolkit for Language Modeling and Information Retrieval via Yahoo	LTI/LemurProject Nutch Spider/Nutch-1.0-dev (lti crawler for CMU; http://www.lti.cs.cmu.edu; changkuk at cmu dot edu)
1022	LTI - The Lemur Toolkit for Language Modeling and Information Retrieval via Yahoo	LTI/LemurProject Nutch Spider/Nutch-1.0-dev (Research spider using Nutch; http://www.lemurproject.org; mhoy@cs.cmu.edu)
1023	Luchs.at (Linux Wiki) link checking	luchs.at URL checker
1024	Lunascape IE based browser (Japan)	Lunascape
1025	Ultimate Search / Smartdesk (no website) robot	lwp-trivial/1.32
1026	Search4free robot	lwp-trivial/1.34
1027	Search4free robot	lwp-trivial/1.34
1028	Expert HTML online source viewer	lwp-trivial/1.35
1029	Expert HTML online source viewer	lwp-trivial/1.35
1030	Perl LWP:Collective module	LWP::Simple/5.22
1031	Perl LWP:Collective module	LWP::Simple/5.36
1032	Perl LWP:Collective module - Linkomatic robot	LWP::Simple/5.48
1033	Perl LWP:Collective module - secure-netz.de link checking (in conjunction w. libwww-perl/5.50)	LWP::Simple/5.50
1034	Perl LWP:Collective module - Inktomi (62.253.64.x) robot	LWP::Simple/5.51
1035	Perl LWP:Collective module - Only.com	LWP::Simple/5.53
1036	Perl LWP:Collective module	LWP::Simple/5.63
1037	ThePlanet/jaja-jak-globusy.com Google Adsense refferer spam bot from 70.85.116.* / 70.84.128.xxx / 70.85.193.xxx	LWP::Simple/5.803
1038	Lycos spider	Lycos_Spider_(modspider)
1039	Lycos spider	Lycos_Spider_(T-Rex)
1040	Bobcat - Text and Lynx based DOS browser	Lynx/2-4-2 (Bobcat/0.5 [DOS] Jp Beta04)
1041	Lynx 2.x text mode browser	Lynx/2.6 libwww-FM/2.14
1042	seebot.org online service - uses lynx browser for crawlers view of web pages	Lynx/2.8 (;http://seebot.org)
1043	Lynx 2.x text mode browser	Lynx/2.8.3dev.9 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/0.9.6
1044	Lynx 2.x text mode browser used as robot via cogentco.com	Lynx/2.8.4rel.1 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/0.9.6c (human-guided@lerly.net)
1045	Some spam bot	Mac Finder 1.0.xx
1046	UKWizz search robot	Mackster( http://www.ukwizz.com )
1047	Wind.it client user-agent ?	Mag-Net
1048	All Magic/Wap wml service for mobile devices	MagicWML/1.0 (forcewml)
1049	Magpie RSS - PHP RSS Parser	MagpieRSS/0.7x (+http://magpierss.sf.net)
1050	Mahiti.com India search crawler	Mahiti.Com/Mahiti Crawler-1.0 (Mahiti.Com; http://mahiti.com ; mahiti.com)
1051	Mail.ru search	Mail.Ru/1.0
1052	Unknown Bea robot	mailto:webcraft@bea.com
1053	SLI Systems mammoth robot	mammoth/1.0 ( http://www.sli-systems.com/)
1054	Looksmart robot	MantraAgent
1055	Map of the Internet visual search engine index robot	MapoftheInternet.com ( http://MapoftheInternet.com)
1056	Kolibri.de robot	Mariner/5.1b [de] (Win95; I ;Kolibri gncwebbot)
1057	Pilot Hitlist web site analysis	Marketwave Hit List
1058	Looksmart directory page analysis	Martini
1059	Looksmart directory page analysis	MARTINI
1060	Marvin Medhunt robot	Marvin v0.3
1061	Sagool search Japan robot	MaSagool/1.0 (MaSagool; http://sagool.jp/; info@sagool.jp)
1062	Mass Downloader download manager	Mass Downloader 2.x
1063	Masterseek (Scandinavia) Beta business search ?	MasterSeek
1064	Lexibot (exMataHari) search software	Mata Hari/2.00
1065	Virgilio Italy robot (212.48.11.xxx) using Fast Enterprise Search	Matrix S.p.A. - FAST Enterprise Crawler 6 (Unknown admin e-mail address)
1066	Maxomo multimedia search robot	maxomobot/dev-20051201 (maxomo; http://67.102.134.34:4047/MAXOMO/MAXOMObot.html; maxomobot@maxomo.com)
1067	Unknown robot from McAfee Austria (80.123.144.xx)	McBot/5.001 (windows; U; NT4.0; en-us)
1068	MegaDownload files search robot	MDbot/1.0 (+http://www.megadownload.net/bot.html)
1069	Substitute for Windows Media Player	Media Player Classic
1070	Media Find crawler	MediaCrawler-1.0 (Experimental)
1071	Google AdSense robot	Mediapartners-Google/2.1 ( http://www.googlebot.com/bot.html)
1072	WWW.fi Media Search	MediaSearch/0.1
1073	Search UK robot	MegaSheep v1.0 (www.searchuk.com internet sheep)
1074	Megite web2.0 RSS and news service software	Megite2.0 (http://www.megite.com)
1075	Mercator crawler software (used by Altavista)	Mercator-1.x
1076	Mercator crawler software (used by Altavista)	Mercator-2.0
1077	Mercator crawler software (used by Altavista)	Mercator-Scrub-1.1
1078	MetaEuro.com Clustering Web Search Engine crawler	Metaeuro Web Crawler/0.2 (MetaEuro Web Search Clustering Engine; http://www.metaeuro.com; crawler at metaeuro dot com)
1079	MetaGer search robot (Germany)	MetaGer-LinkChecker
1080	MetaGer search robot (Germany)	MetagerBot/0.8-dev (MetagerBot; http://metager.de; )
1081	MetaGer search robot (Germany)	MetaGer_PreChecker0.1
1082	Download Express download manager	MetaProducts Download Express/1.x
1083	Metaspinner search robot - Germany	Metaspinner/0.01 (Metaspinner; http://www.meta-spinner.de/; support@meta-spinner.de/)
1084	Metatagsdir.com directory index spider	metatagsdir/0.7 (+http://metatagsdir.com/directory/)
1085	Microsoft Foundation Class Library - i.e. used for e-mail harvesting from 68.154.96.xx (bellsouth.net)	MFC Foundation Class Library 4.0
1086	Microsoft.com user agent	MFC_Tear_Sample
1087	Advanced Site Crawler web site ripper and extractor	MFHttpScan
1088	GigaBaz Brainbot (Germany) robot (213.139.152.xx)	MicroBaz
1089	MS Office 2000 acting as WebDAV client	Microsoft Data Access Internet Publishing Provider Cache Manager
1090	MS Office 2000 acting as WebDAV client	Microsoft Data Access Internet Publishing Provider DAV
1091	Server probe for data access operations using MS Frontpage with OPTION header	Microsoft Data Access Internet Publishing Provider Protocol Discovery
1092	MS Office 2000 acting as WebDAV client	Microsoft Data Access Internet Publishing Provider Protocol Discovery
1093	Microsoft Log Parser text query tool	Microsoft Log Parser 2.2
1094	MS Small Business Server content indexer	Microsoft Small Business Indexer
1095	user agent looks for form-mail components (spam-bot)	Microsoft URL Control - 6.00.8xxx
1096	Unknown robot from Microsoft.com (131.107.163.xx)	MicrosoftPrototypeCrawler (How's my crawling? mailto:newbiecrawler@hotmail.com)
1097	Secure Computing SmartFilterWhere / Bess web filter (192.55.214.xx)	Microsoft_Internet_Explorer_5.00.438 (fjones@isd.net)
1098	xpc-mii.net HTTP server message	MIIxpc/4.2
1099	The Mindjet blog MindManager category	Mindjet MindManager
1100	unknown robot via Korea Telecom (211.218.xxx.xxx)	minibot
1101	mini- Rank website popularity tool	miniRank/1.6 (Website ranking; www.minirank.com; robot)
1102	unknown robot via nec.co.jp Telecom (210.143.35.xx)	MiracleAlphaTest
1103	Some spam bot	Missauga Locate 1.0.0
1104	Some spam bot	Missigua Locator 1.9
1105	Some spam bot	Missouri College Browse
1106	Mister PiX picture finding software	Mister Pix II 2.02a
1107	Mister PiX picture finding software	Mister PiX version.dll
1108	Misterbot search France robot	Misterbot-Nutch/0.7.1 (Misterbot-Nutch; http://www.misterbot.fr; admin@misterbot.fr)
1109	Miva / ex Findwhat.com search robot (66.150.55.2xx)	Miva (AlgoFeedback@miva.com)
1110	Some spam bot from Jasmine Internet - Bangkok (203.147.0.xx)	Mizzu Labs 2.2
1111	Majestic-12 DSearch MJ12bot (Experimental distributed crawler)	MJ12bot/vx.x.x (http://majestic12.co.uk/bot.php?+)
1112	Majestic-12 DSearch MJ12bot (Experimental distributed crawler)	MJ12bot/vx.x.x (http://www.majestic12.co.uk/projects/dsearch/mj12bot.php)
1113	MJB SEO Club MJBot	MJBot (SEO assessment)
1114	MLBot - metadata labs web crawler for building a media index (beta)	MLBot (www.metadatalabs.com)
1115	mnoGoSearch (ex UdmSearch) software robot	MnogoSearch/3.2.xx
1116	Unknown bad bot - maybe guestbook spamming or email harvesting	Mo College 1.9
1117	Goo Japan / Inktomi robot (210.173.179.xx)	moget/x.x (moget@goo.ne.jp)
1118	Goo Japan / Inktomi robot (210.173.179.xx)	mogimogi/1.0
1119	moiNag - net.art generator	moiNAG 0.02
1120	Mojeek Search Preview robot (217.155.205.xx)	MojeekBot/0.x (archi; http://www.mojeek.com/bot.html)
1121	Greasemonkey Firefox extension	monkeyagent
1122	Moonbrowser - IE based browser (Japan)	MoonBrowser (version 0.41 Beta4)
1123	Moreover / FeedDirect RSS feed robot	Moreoverbot/x.00 (+http://www.moreover.com)
1124	MixCat robot s. also Felix	Morris - Mixcat Crawler ( http://mixcat.com)
1125	Robots.txt online checker	Motoricerca-Robots.txt-Checker/1.0 (http://tool.motoricerca.info/robots-checker.phtml)
1126	Obigo WAP browser for mobiles on Motorola V3	Motorola-V3m Obigo
1127	MPRM Group Ltd. Spider Monkey robot	Mouse-House/7.4 (spider_monkey spider info at www.mobrien.com/sm.shtml)
1128	Movable Type web-based personal publishing system	MovableType/x.x
1129	Mozdex Open search engine spider (65.98.100.2xx)	mozDex/0.xx-dev (mozDex; http://www.mozdex.com/en/bot.html; spider@mozdex.com)
1130	Bell Nexxia / Sympatico Canada user robot & spoofed referer from diff. IPs	Mozi!
1131	Unknown robots from diff. IPs	Mozilla
1132	libwhisker - HTTP client and utility - Perl library	Mozilla (libwhisker/2.4)
1133	http://www.somewhere.com robot	Mozilla (Mozilla@somewhere.com)
1134	BotSeer search engine for robots.txt	Mozilla 4.0(compatible; BotSeer/1.0; +http://botseer.ist.psu.edu)
1135	PDA Pocket IE 2.x Windows CE	Mozilla/1.1 (compatible; MSPIE 2.0; Windows CE)
1136	Oregano browser for RISC OS	Mozilla/1.10 [en] (Compatible; RISC OS 3.70; Oregano 1.10)
1137	IE 2.x WinNT	Mozilla/1.22 (compatible; MSIE 2.0d; Windows NT)
1138	EudoraWeb 2.0 browser (Eudora Internet Suite) for PalmOS	Mozilla/1.22 (compatible; MSIE 5.01; PalmOS 3.0) EudoraWeb 2
1139	Dummy user agent - i.e. used by Namo Web Editor	Mozilla/2.0
1140	AOL Mac	Mozilla/2.0 (compatible; AOL 3.0; Mac_PowerPC)
1141	AOL Win 3.x	Mozilla/2.0 (Compatible; AOL-IWENG 3.0; Win16)
1142	Ask Jeeves /Teoma robot	Mozilla/2.0 (compatible; Ask Jeeves)
1143	Ask Jeeves /Teoma robot	Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
1144	Ask Jeeves /Teoma robot	Mozilla/2.0 (compatible; Ask Jeeves/Teoma; http://about.ask.com/en/docs/about/webmasters.shtml)
1145	Ask Jeeves /Teoma robot	Mozilla/2.0 (compatible; Ask Jeeves/Teoma; http://sp.ask.com/docs/about/tech_crawling.html)
1146	Direct Hit Robot	Mozilla/2.0 (compatible; EZResult -- Internet Search Engine)
1147	MS Frontpage x.x web editor	Mozilla/2.0 (compatible; MS FrontPage x.0)
1148	IE 2.x Mac Power PC	Mozilla/2.0 (compatible; MSIE 2.1; Mac_PowerPC)
1149	IE 3.x WinNT	Mozilla/2.0 (compatible; MSIE 3.02; Update a; AK; Windows NT)
1150	IE 3.x AOL Win95	Mozilla/2.0 (compatible; MSIE 3.02; Update a; AOL 3.0; Windows 95)
1151	IE 3.x Win95	Mozilla/2.0 (compatible; MSIE 3.0; AK; Windows 95)
1152	IE 3.x Win 3.1	Mozilla/2.0 (compatible; MSIE 3.0; Windows 3.1)
1153	IE 3.x WinXP	Mozilla/2.0 (compatible; MSIE 3.0B; Win32)
1154	Borland Delphi .OCX component used by WebCollector email harverster	Mozilla/2.0 (compatible; NEWT ActiveX; Win32)
1155	Thunderstone's Webinator Web indexing program	Mozilla/2.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)
1156	Check&Get bookmark and link checking tool	Mozilla/2.0 compatible; Check&Get 1.1x (Windows 98)
1157	Netscape 2.x Win3.x International	Mozilla/2.01 (Win16; I)
1158	Netscape 2.x Gold Win95	Mozilla/2.02Gold (Win95; I)
1159	Faked user agent for diff. purposes i.e.: - some download manager - E-mail harvesting	Mozilla/3.0 (compatible)
1160	AvantGo PDA browser	Mozilla/3.0 (compatible; AvantGo 3.2)
1161	Searchhippo robot	Mozilla/3.0 (compatible; Fluffy the spider; http://www.searchhippo.com/; info@searchhippo.com)
1162	HP Web PrintSmart (discontinued) - web page printing software	Mozilla/3.0 (compatible; HP Web PrintSmart 04b0 1.0.1.34)
1163	Internet Direct Library for Borland (often used as e-mail address collector and mass mailing tool)	Mozilla/3.0 (compatible; Indy Library)
1164	Outertechs Linkman bookmark tool	Mozilla/3.0 (compatible; Linkman)
1165	Euroferret robot	Mozilla/3.0 (compatible; MuscatFerret/1.5.4; claude@euroferret.com)
1166	Euroferret robot	Mozilla/3.0 (compatible; MuscatFerret/1.5; olly@muscat.co.uk)
1167	Euroferret robot	Mozilla/3.0 (compatible; MuscatFerret/1.6.x; claude@euroferret.com)
1168	Netart Generator - script generated random websites	Mozilla/3.0 (compatible; netart generator/1.0; libwww-perl/5.64)
1169	NetPositive BEOS browser	Mozilla/3.0 (compatible; NetPositive/2.2)
1170	Opera 3.x Win3.x	Mozilla/3.0 (compatible; Opera/3.0; Windows 3.1) v3.1
1171	Opera 3.x Win95/NT	Mozilla/3.0 (compatible; Opera/3.0; Windows 95/NT4) 3.2
1172	Perman Surfer bookmark tool	Mozilla/3.0 (compatible; PerMan Surfer 3.0; Win95)
1173	Web Link Validator link validation software	Mozilla/3.0 (compatible; REL Software Web Link Validator 2.x)
1174	Scan4Mail online mail extraction service	Mozilla/3.0 (compatible; scan4mail (advanced version) http://www.peterspages.net/?scan4mail)
1175	WebWobot UK search engine robot (82.43.129.2xx)	Mozilla/3.0 (compatible; ScollSpider; http://www.webwobot.com)
1176	Web Link Validator link validation software	Mozilla/3.0 (compatible; Web Link Validator 2.x)Web Link Validator http://www.relsoftware.com/ link validation software
1177	Xelios Web Capture (now Wysigot) website downloading tool (Discontinued)	Mozilla/3.0 (compatible; WebCapture x.x; Auto; Windows)
1178	Iprospect search engine positioning using Thunderstone's Webinator	Mozilla/3.0 (compatible; Webinator-DEV01.home.iprospect.com/2.56)
1179	CyberAlert's Media Monitor using Thunderstone's Webinator	Mozilla/3.0 (compatible; Webinator-indexer.cyberalert.com/2.56)
1180	Viking server user/client	Mozilla/3.0 (Compatible;Viking/1.8)
1181	One of DC-Sakuras download manager user-agent names	Mozilla/3.0 (DreamPassport/3.0)
1182	Ilse Netherlands robot (62.69.178.xx)	Mozilla/3.0 (INGRID/3.0 MT; webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/?aanmeld_mode=webhints)
1183	Liberate DTV server suite / TV-emulator	Mozilla/3.0 (Liberate DTV 1.1)
1184	Planetweb 2.1 Browser (discontinued) for Dreamcast	Mozilla/3.0 (Planetweb/2.100 JS SSL US; Dreamcast US)
1185	http://www.goo.ne.jp /Inktomi robot	Mozilla/3.0 (Slurp.so/Goo; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
1186	Inktomi (Hotbot-Lycos-NBCi) robot - 72.30.61.xx(x)	Mozilla/3.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
1187	Inktomi (Hotbot-Lycos-NBCi) robot - 72.30.61.xx(x)	Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
1188	WiseGuys robot Netherland - 82.94.216.2	Mozilla/3.0 (Vagabondo/1.1 MT; webcrawler@NOSPAMwise-guys.nl; http://webagent.wise-guys.nl/)
1189	WiseGuys robot Netherland - 82.94.216.2	Mozilla/3.0 (Vagabondo/1.x MT; webagent@wise-guys.nl; http://webagent.wise-guys.nl/)
1190	Ilse Netherlands robot	Mozilla/3.0 (Vagabondo/2.0 MT; webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/?aanmeld_mode=webhints)
1191	WiseGuys robot Netherland - 82.94.216.2	Mozilla/3.0 (Vagabondo/2.0 MT; webcrawler@NOSPAMwise-guys.nl; http://webagent.wise-guys.nl/)
1192	Netscape 3.x Win3.x	Mozilla/3.0 (Win16; I)
1193	Netscape 3.x Win95	Mozilla/3.0 (Win95; I)
1194	Netscape 3.x WinNT	Mozilla/3.0 (WinNT; I)
1195	Netscape 3.x FreeBSD	Mozilla/3.0 (WorldGate Gazelle 3.5.1 build 11; FreeBSD2.2.8-STABLE)
1196	Netscape 3.x OSF1 V4.0 alpha	Mozilla/3.0 (X11; I; OSF1 V4.0 alpha)
1197	AOL Web TV	Mozilla/3.0 NAVIO_AOLTV (11; 13; Philips; PH200; 1; R2.0C36_AOL.0110OPTIK; R2.0.0139d_OPTIK)
1198	WebTV	Mozilla/3.0 WebTV/1.2 (compatible; MSIE 2.0)
1199	Amiga Voyager Browser Amiga	Mozilla/3.01 (compatible; AmigaVoyager/2.95; AmigaOS/MC680x0)
1200	Links2Go robot	Mozilla/3.01 (Compatible; Links2Go Similarity Engine)
1201	Netgem Netbox cable modem TV Box Linux	Mozilla/3.01 (compatible; Netbox/3.5 R92; Linux 2.2)
1202	Netscape 3.x Mac	Mozilla/3.01-C-MACOS8 (Macintosh; I; PPC)
1203	Netscape 3.x Linux	Mozilla/3.01Gold (X11; I; Linux 2.0.32 i486)
1204	Netscape 3.x SunOS	Mozilla/3.01Gold (X11; I; SunOS 5.5.1 sun4m)
1205	Netscape 3.x Irix	Mozilla/3.01SGoldC-SGI (X11; I; IRIX 6.3 IP32)
1206	ANT Fresco Browser Risc OS	Mozilla/3.04 (compatible; ANTFresco/2.13; RISC OS 4.02)
1207	NCBrowser ANT Fresco Browser Risc OS	Mozilla/3.04 (compatible; NCBrowser/2.35; ANTFresco/2.17; RISC OS-NC 5.13 Laz1UK1309)
1208	QNX OS Voyager embedded browser	Mozilla/3.04 (compatible;QNX Voyager 2.03B ;Photon)
1209	I-Opener (was www.netpliance.com/) web PC	Mozilla/3.x (I-Opener 1.1; Netpliance)
1210	Yahoo Mindset: Intent-driven Search (66.228.182.1xx)	Mozilla/4.0
1211	Agada search (Germany) robot	Mozilla/4.0 (agadine3.0) www.agada.de
1212	URLBase 6 bookmark manager	Mozilla/4.0 (Compatible); URLBase 6
1213	Astrafind! adult search robot (66.98.252.xx)	Mozilla/4.0 (compatible: AstraSpider V.2.1 : astrafind.com)
1214	WiseGuys robot Netherland - 82.94.216.2	Mozilla/4.0 (compatible; Vagabondo/2.2; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
1215	WiseGuys robot Netherland - 82.94.216.2	Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
1216	ReGet Deluxe! download manager	Mozilla/4.0 (compatible; <a href=http://www.reget.com>ReGet Deluxe 5.1</a>; Windows NT 5.1)
1217	Advanced Email Extractor e-mail collector (spam bot)	Mozilla/4.0 (compatible; Advanced Email Extractor v2.xx)
1218	Arachmo Spider - web site file extraction tool	Mozilla/4.0 (compatible; Arachmo)
1219	Novell Border Manager security suite	Mozilla/4.0 (compatible; BorderManager 3.0)
1220	Best of the Web directory link checking	Mozilla/4.0 (compatible; BOTW Spider; +http://botw.org)
1221	Blitzsuche Germany robot	Mozilla/4.0 (compatible; B_L_I_T_Z_B_O_T)
1222	Content Control from Blue Coat	Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.2-Build-0)
1223	Check&Get bookmark manager, web change monitor and archiver	Mozilla/4.0 (compatible; Check&Get 3.0; Windows NT)
1224	Christcentral.com Christcrawler (was www.christcrawler.com)	Mozilla/4.0 (compatible; ChristCrawler.com ChristCrawler@ChristCENTRAL.com)
1225	Yahoo Search Marketing crawler (68.142.211.1xx)	Mozilla/4.0 (compatible; crawlx, crawler@trd.overture.com)
1226	DAUMOA - Daum search Korea robot (211.115.109.xxx)	Mozilla/4.0 (compatible; DAUMOA-video; +http://ws.daum.net/aboutkr.html)
1227	DepSpid distributed web crawler for link dependencies	Mozilla/4.0 (compatible; DepSpid/5.0x; +http://about.depspid.net)
1228	Download Mage download manager	Mozilla/4.0 (compatible; DnloadMage 1.0)
1229	Fast/Alltheweb crawler	Mozilla/4.0 (compatible; FastCrawler3 support-fastcrawler3@fast.no)
1230	Fluid Dynamics Search Engine (FDSE) robot used by Abadoor.de	Mozilla/4.0 (compatible; FDSE robot)
1231	GPU Distributed Search Engine crawler	Mozilla/4.0 (compatible; GPU p2p crawler http://gpu.sourceforge.net/search_engine.php)
1232	Grub open source crawler	Mozilla/4.0 (compatible; grub-client-0.2.x; Crawl your stuff with http://grub.org)
1233	Grub open source crawler	Mozilla/4.0 (compatible; grub-client-0.3.x; Crawl your own stuff with http://grub.org)
1234	Grub open source crawler used by Looksmart ( 64.241.242.xx)	Mozilla/4.0 (compatible; grub-client-2.x)
1235	ibisBrowser Japanese mobile browser	Mozilla/4.0 (compatible; ibisBrowser)
1236	Novell iChain Cool Solutions caching	Mozilla/4.0 (compatible; ICS 1.2.xxx)
1237	IE Favorites Check - Bookmark manager	Mozilla/4.0 (compatible; IE-Favorites-Check-0.5)
1238	Iplexx Austria (webhosting company) logfile spamming bot	Mozilla/4.0 (compatible; Iplexx Spider/1.0 http://www.iplexx.at)
1239	KeepNi Monitors - Web site monitoring / link checking tool	Mozilla/4.0 (compatible; KeepNI web site monitor)
1240	NetPromoter Link Utility link checking tool	Mozilla/4.0 (compatible; Link Utility; http://net-promoter.com)
1241	Lotus Notes 5.0 browser	Mozilla/4.0 (compatible; Lotus-Notes/5.0; Windows-NT)
1242	IE 4.x AOL Win98	Mozilla/4.0 (compatible; MSIE 4.01; AOL 4.0; Windows 98)
1243	IE 4.x Mac Power PC	Mozilla/4.0 (compatible; MSIE 4.01; Mac_PowerPC)
1244	Internet Explorer 4.0 URL check	Mozilla/4.0 (compatible; MSIE 4.01; MSIECrawler; Windows 95)
1245	Vonna search robot	Mozilla/4.0 (compatible; MSIE 4.01; Vonna.com b o t)
1246	IE 4.x Win95	Mozilla/4.0 (compatible; MSIE 4.01; Windows 95)
1247	IE PDA Browser Windows CE	Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; MSN Companion 2.0; 800x600; Compaq)
1248	Orange France robot for mobiles	Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPC; 240x320; SPV M700; OpVer 19.123.2.733) OrangeBot-Mobile 2008.0 (mobilesearch.support@orange-ftgroup.com)
1249	IE for Windows CE on a PocketPC (HP iPAQ)	Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPS; 240x320)
1250	IE PDA Browser Windows CE	Mozilla/4.0 (compatible; MSIE 4.01; Windows NT Windows CE)
1251	IE 4.x WinNT	Mozilla/4.0 (compatible; MSIE 4.01; Windows NT)
1252	diff. IPs / services i.e.: - Microsoft server information robot (see link) - Okanagan Internet Junction web filter (robot)	Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft
1253	Unknown robot from American College of Radiology (ACR) running MS Site Server	Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) ACR
1254	Indonesia Interactive Web-portal robot on MS Site Server	Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) Indonesia Interactive
1255	Webquestdesigns hosting	Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) WebQuest Designs
1256	Avirt Gateway proxy server	Mozilla/4.0 (compatible; MSIE 5.01; Windows 95) via <B>Avirt Gateway Server</B> v4.0
1257	Metacarta.com (66.28.xx.xxx) robot	Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0) (samualt9@bigfoot.com)
1258	NetCaptor IE browser addon	Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; NetCaptor 6.5.0RC1)
1259	IE 5.x AOL Win95 Sureseeker search plugin	Mozilla/4.0 (compatible; MSIE 5.0; AOL 5.0; Windows 95; DigExt; Gateway2000; sureseeker.com)
1260	IE 5.x Mac PowerPC AtHome user	Mozilla/4.0 (compatible; MSIE 5.0; Mac_PowerPC; AtHome021)
1261	www.netnose.com crawler	Mozilla/4.0 (compatible; MSIE 5.0; NetNose-Crawler 2.0; A New Search Experience: http://www.netnose.com)
1262	WinXP via CERN httpd proxy server	Mozilla/4.0 (compatible; MSIE 5.0; Win32) via proxy gateway CERN-HTTPD/3.0 libwww/2.17
1263	Echo.com robot	Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) TrueRobot; 1.5
1264	Voila.fr robot	Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)
1265	Voila.fr robot	Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot; 1.6
1266	WinME Opera 5.x	Mozilla/4.0 (compatible; MSIE 5.0; Windows ME) Opera 5.11 [en]
1267	Kyosoft's Link Checker	Mozilla/4.0 (compatible; MSIE 5.0; Windows ME; Link Checker 2.x.xx http://www.kyosoft.com)
1268	Beijing Express Email Address Extractor via DHCP Data Transport Services (DTS)	Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent
1269	Girafa (browser plug-in) robot	Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com)
1270	Galaxy robot (63.121.41.xxx)	Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.psychedelix.com)
1271	Galaxy robot (63.121.41.xxx)	Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.psychedelix.com/; http://www.galaxy.com/info/crawler.html)
1272	Yandex Search Russia link checking (213.180.206.2xx)	Mozilla/4.0 (compatible; MSIE 5.0; YANDEX)
1273	Gobeez starting page plugin	Mozilla/4.0 (compatible; MSIE 5.5; AOL 4.0; Windows 98; GoBeez (www.gobeez.com))
1274	IE 5.5 Win95 Hotbar plug-in	Mozilla/4.0 (compatible; MSIE 5.5; Windows 95; Transmission Segment; Hotbar 2.0)
1275	Crazy Browser - IE based tabbed Browser	Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Crazy Browser 1.x.x)
1276	Wanadoo Internet services	Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; KITV4.7 Wanadoo)
1277	Safexplorer (safexplorer.com - site is offline) kids browser	Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; SAFEXPLORER TL)
1278	Katiesoft Scroll (ex www.katiesoft.com now discarded) & SimulBrowse (ex www.simulbrowse.com now dead) IE browser plugins	Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; SYMPA; Katiesoft 7; SimulBrowse 3.0)
1279	Windows ME BTOpenworld Internet services	Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; BTinternet V8.1)
1280	Windows ME Internet Explorer URL check	Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; MSIECrawler)
1281	Cobion Germany Brand Protection Services robot	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)
1282	Cobion Germany Brand Protection Services robot	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; QXW03018)
1283	IE 5.5 Win2000 / user agent	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Active Cache Request
1284	Maybe: - MS Internet Security & Acceleration Server (ISA) cache refreshing request (see link) or - IE 5.5 Win2000 probably with some (website) API request component (see 2nd link) - suspected as email-harvester / site scanning tool (see http://www.byte.com/documents/s=493/byt20010208s0001/index.htm	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
1285	IE 5.5 Win2000 with MS.NET SDK	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; .NET CLR 1.0.3705)
1286	IE 5.5 Win2000 / user agent w. AI RoboForm (AIRF) password manager	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; AIRF)
1287	AspTear URL fetching program component / Download32.com spider	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; AspTear 1.5)
1288	Nokia.com network	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; N_o_k_i_a)
1289	Unknown Object Sciences Corp. robot using the HTTPClient	Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; T312461) RPT-HTTPClient/0.3-3E
1290	Singingfish media spider (64.12.186.2xx) via AOL search	Mozilla/4.0 (compatible; MSIE 6.0 compatible; Asterias Crawler v4; +http://www.singingfish.com/help/spider.html; webmaster@singingfish.com); SpiderThread Revision: 3.10
1291	Megaupload Mega Manager - Download manager toolbar for IE	Mozilla/4.0 (compatible; MSIE 6.0; AOL 9.0; Windows 98; .NET CLR 1.1.4322; MEGAUPLOAD 2.0)
1292	Hotbar IE graphical skin	Mozilla/4.0 (compatible; MSIE 6.0; AOL 9.0; Windows NT 5.1; SV1; HbTools 4.7.2)
1293	Skaffe.com directory link checker	Mozilla/4.0 (compatible; MSIE 6.0; MSIE 5.5; Windows NT 5.1) Skampy/0.9.x [en]
1294	TargetSeek Crawler concerning electronics industry product announcements	Mozilla/4.0 (compatible; MSIE 6.0; TargetSeek/1.0; +http://www.targetgroups.net/TargetSeek.html)
1295	IE 6.0 WebWasher ad filter	Mozilla/4.0 (compatible; MSIE 6.0; Win32) WebWasher 3.0
1296	Web Link Validator link validation software	Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) REL Software Web Link Validator 2.x)
1297	Web Link Validator link validation software	Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) Web Link Validator 2.x)
1298	IE 6.0 Netmanager IE add-on	Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Net M@nager V3.02 - www.vinn.com.au)
1299	WebLight web analyzer & link checker	Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; support@illumit.com; http://www.illumit.com/Products/weblight/)
1300	Abolimba Multibrowser - IE based browser	Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; http://www.Abolimba.de)
1301	Lunascape IE based browser (Japan)	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; Lunascape 2.1.3)
1302	Google wireless transcoder (GWT) proxy for rewriting websites for mobiles	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google Wireless Transcoder;)
1303	Tüzilla (Germany) - ODP link checking using Robozilla	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ODP entries t_st; http://tuezilla.de/t_st-odp-entries-agent.html)
1304	Tüzilla (Germany) - ODP link checking using Robozilla	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ODP links test; http://tuezilla.de/test-odp-links-agent.html)
1305	ZoomSpider.Net indexing robot for several directorys	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ZoomSpider.net bot; .NET CLR 1.1.4322)
1306	unknown robot from 64.246.44.xx	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (dns_admin@c-a-s-h.com)
1307	Covac Software UPPS (Universal PHP Proxy Server) - free public proxy server	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Covac UPPS Cathan 1.2.5;)
1308	GetNetWise Crayon Crawler web filter	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Crayon Crawler; snprtz|T04056566514940; (R1 1.5))
1309	Deepnet Explorer - IE based browser	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Deepnet Explorer)
1310	Heritrix Internet Archive's open-source web project used by Analysis Projects at UW	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; heritrix/1.3.0 http://www.cs.washington.edu/research/networking/websys/)
1311	IE 6x WinXP Hotbar plug-in	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 3.0)
1312	IE 6x WinXP iOpus Internet Macros - Internet-based macro recorder	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; iOpus-I-M)
1313	iRider - IE based browser / Free Download Manager (FDM)	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; iRider 2.21.1108; FDM)
1314	KKman http://www.kkman.com/ - Japanese IE based browser	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; KKman3.0)
1315	IE 6x WinXP MathPlayer mathematical notation plugin	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MathPlayer2.0)
1316	Maxton (ex MyIE2) - IE based browser	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Maxthon)
1317	IE 6x WinXP peoplepc online PeoplePal IE toolbar	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; PeoplePal 3.0; MSIECrawler)
1318	IE 6x WinXP / I-Opener (was www.netpliance.com/) web PC	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; IOpener Release 1.1.04)
1319	Qihoo search (China) robot	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; QihooBot 1.0 qihoobot@qihoo.net)
1320	SimBar IE toolbar for accessing The Sims sites / Infopath IE form & spreadsheet plugin	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SIMBAR Enabled; InfoPath.1)
1321	IE 6x WinXP Stumble Upon IE toolbar	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; StumbleUpon.com 1.760; .NET CLR 1.1.4322)
1322	Balsa Productions embedded web browser package for Borland Delphi	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Embedded Web Browser from: http://bsalsa.com/; MSIECrawler)
1323	ChangeDetection robot for web page monitoring	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.changedetection.com/bot.html )
1324	IE 6x WinXP also used by WebSite Pro HTML editor	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
1325	DX-Browser - German IE based browser	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; DX-Browser 5.0.0.0)
1326	ezPeer+ P2P IE addon	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FunWebProducts; ezPeer+ v1.0 Beta (0.4.1.98); ezPeer+ v1.0 (0.5.0.00); .NET CLR 1.1.4322; MSIECrawler)
1327	Axandra IBP website promotion software ?	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; IBP; .NET CLR 1.1.4322)
1328	MRA = Mail.ru Agent - Instant Messenger / VoIP	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.3 (build 01218))
1329	MSN Search robot (207.46.89.xx)	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot)
1330	Link Commander bookmark manager	Mozilla/4.0 (compatible; MSIE 7.0; Win32) Link Commander 4.0
1331	IE 7.0 - WinXP	Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; bgft)
1332	GTB = Google Toolbar Internet Explorer add-on	Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; GTB5; User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://bsalsa.com) ; .NET CLR 2.0.50727)
1333	MSIE 7.0 *and* Trident token used by Internet Explorer 8 in compatibility view mode	Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; Tablet PC 2.0)
1334	Internet Explorer 8	Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648)
1335	IE 8.0 (beta) on Win Vista	Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0)
1336	Bsalsa embedded browser	Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0; Orange 8.0; GTB6.3; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; Embedded Web Browser from: http://bsalsa.com/; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30618; OfficeLiveConnector.1.3; OfficeLivePatch.1.3)
1337	DAUMOA - Daum search Korea robot (211.115.109.xxx)	Mozilla/4.0 (compatible; MSIE enviable; DAUMOA 2.0; DAUM Web Robot; Daum Communications Corp., Korea; +http://ws.daum.net/aboutkr.html)
1338	DAUMOA - Daum search Korea robot (211.115.109.xxx)	Mozilla/4.0 (compatible; MSIE is not me; DAUMOA/1.0.1; DAUM Web Robot; Daum Communications Corp., Korea)
1339	Naver Search Korea Naverbot	Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/delete_main.asp)
1340	Netcraft webserver info	Mozilla/4.0 (compatible; Netcraft Web Server Survey)
1341	NetPromoter Link Utility link checking tool	Mozilla/4.0 (compatible; NetPromoter Spider;http://www.net-promoter.com/)
1342	Opera 3.x WinNT	Mozilla/4.0 (compatible; Opera/3.0; Windows 4.10) 3.51 [en]
1343	Powermarks bookmark manager	Mozilla/4.0 (compatible; Powermarks/3.5; Windows 95/98/2000/NT)
1344	RSS Popper - MS Outlook RSS reader plugin	Mozilla/4.0 (compatible; RSS Popper)
1345	SiteKiosk public terminal browser	Mozilla/4.0 (compatible; SiteKiosk 4.0; MSIE 5.0; Windows 98; SiteCoach 1.0)
1346	Entireweb Search Speedyspider (62.13.25.xxx)	Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com)
1347	SiteProbe - website status checking	Mozilla/4.0 (compatible; SPENG)
1348	Super Cleaner privacy tool (bookmark checking)	Mozilla/4.0 (compatible; SuperCleaner 2.xx; Windows 98)
1349	Synapse - Apache web service for processing XML documents	Mozilla/4.0 (compatible; Synapse)
1350	Web2PDF - Adobe Acrobat plugin for site traversal and other services for the Web Capture feature	Mozilla/4.0 (compatible; WebCapture 3.0; Windows)
1351	Windows HTTP Services (WinHTTP / XML-parser)	Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5)
1352	WSN Links PHP directory software	Mozilla/4.0 (compatible; WSN Links)
1353	Euro Directory (German / Austrian) directory link checking	Mozilla/4.0 (compatible; www.euro-directory.com; urlchecker1.0)
1354	Galaxy robot	Mozilla/4.0 (compatible; www.galaxy.com)
1355	Linkguard.com link validation (service is offline)	Mozilla/4.0 (compatible; www.linkguard.com Linkguard Online 1.0; Windows NT)
1356	Yahoo Search Japan robot (203.141.52.)	Mozilla/4.0 (compatible; Y!J; for robot study; keyoshid)
1357	Yahoo Japan robot (202.93.76.xx)	Mozilla/4.0 (compatible; Yahoo Japan; for robot study; kasugiya)
1358	Faked IE id string used by DeepTrawl link checking tool	Mozilla/4.0 (compatible;MSIE 6.0; Windows NT 5.0; H010818)
1359	spoofed referer by Fantomaster (Multiblocker) anonymity products	Mozilla/4.0 (fantomBrowser)
1360	spoofed referer by Fantomaster (Multiblocker) anonymity products	Mozilla/4.0 (fantomCrew Browser)
1361	unknown robot from - 64.57.223.40 - 66.28.233.xxx (cogentco.com)	Mozilla/4.0 (hhjhj@yahoo.com)
1362	Activtourist Jemma spider	Mozilla/4.0 (JemmaTheTourist;http://www.activtourist.com)
1363	NetFront (v3.x) for Pocket PC (here on Sanyo PM-8200 cell phone)	Mozilla/4.0 (MobilePhone PM-8200/US/1.0) NetFront/3.x MMP/2.0
1364	Google robot from 66.249.66.xxx	Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1365	Google robot from 66.249.66.xxx	Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 FAKE (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1366	Unknown robot from Mozilla.org	Mozilla/4.0 (Mozilla; http://www.mozilla.org/docs/en/bot.html; master@mozilla.com)
1367	ASI - Any Search Info robot	Mozilla/4.0 (Sleek Spider/1.2)
1368	Furl (Looksmart) online bookmark tool robot	Mozilla/4.0 compatible FurlBot/Furl Search 2.0 (FurlBot; http://www.furl.net; wn.furlbot@looksmart.net)
1369	Wisenut robot	Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
1370	Wisenut robot	Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com)
1371	Wisenut robot	Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
1372	Wisenut robot	Mozilla/4.0 compatible ZyBorg/1.0 for Homepage (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com)
1373	Unknown robot from 66.230.140.xx (argon.oxeo.com) maybe an e-mail collector	Mozilla/4.0 efp@gmx.net
1374	WebTV	Mozilla/4.0 WebTV/2.6 (compatible; MSIE 4.0)
1375	Ask / Ask Jeeves robot	Mozilla/4.0 [en] (Ask Jeeves Corporate Spider)
1376	LookSmart spider	Mozilla/4.0(compatible; Zealbot 1.0)
1377	HideMe - Web based anonymous proxy server service	Mozilla/4.01 (compatible; NORAD National Defence Network)
1378	Some download manager spoofing Netscape 4.01	Mozilla/4.01 [en](Win95;I)
1379	Netscape 4.x SunOS 5.6	Mozilla/4.02 [en] (X11; I; SunOS 5.6 sun4u)
1380	Dulance Bot - Dulance automated price comparison engine	Mozilla/4.04 (compatible; Dulance bot; +http://www.dulance.com/bot.jsp)
1381	Netscape 4.x HP-Unix	Mozilla/4.04 [en] (X11; I; HP-UX B.10.20 9000/712)
1382	Netscape 4.x IRIX	Mozilla/4.04 [en] (X11; I; IRIX 5.3 IP22)
1383	Netscape 4.x Macintosh 68k	Mozilla/4.05 (Macintosh; I; 68K Nav)
1384	Netscape 4.x Macintosh PowerPC	Mozilla/4.05 (Macintosh; I; PPC Nav)
1385	Netscape 4.x SunOS 4.1.4	Mozilla/4.05 [en] (X11; I; SunOS 4.1.4 sun4m)
1386	Version 4.08 [en]-98306	Mozilla/4.08 [en] (Win98; U ;Nav)
1387	Netscape 4.x WinNT	Mozilla/4.08 [en] (WinNT; U)
1388	Echo.com robot	Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_TrueRobot/1.4 libwww/5.2.8
1389	Voila.fr robot	Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_VoilaBot/1.6 libwww/5.3.2
1390	HTTrack Offline Browser	Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
1391	iCab MAC Web browser MAC Power PC	Mozilla/4.5 (compatible; iCab 2.5.3; Macintosh; I; PPC)
1392	OmniWeb 4.x.x Mac browser	Mozilla/4.5 (compatible; OmniWeb/4.0.5; Mac_PowerPC)
1393	OmniWeb 4.x.x Mac browser	Mozilla/4.5 (compatible; OmniWeb/4.1-beta-1; Mac_PowerPC)
1394	different IPs using the HTTPClient library (mostly link checking)	Mozilla/4.5 RPT-HTTPClient/0.3-2
1395	RuralNet Internet Services	Mozilla/4.5 [en]C-CCK-MCD {RuralNet} (Win98; I)
1396	Netscape 4.x Linux	Mozilla/4.5b1 [en] (X11; I; Linux 2.0.35 i586)
1397	Cnet robot for Search.com (216.239.114.xx)	Mozilla/4.6 [en] (http://www.cnet.com/)
1398	Netscape 4.x OS/2	Mozilla/4.61 [de] (OS/2; I)
1399	BrowseX cross-platform browser	Mozilla/4.61 [en] (X11; U; ) - BrowseX (2.0.0 Windows)
1400	Nameprotect (12.148.196.128 - 12.148.196.255) snoopbot	Mozilla/4.7
1401	Eidetica earch and text mining spider	Mozilla/4.7 (compatible; http://eidetica.com/spider)
1402	Intelliseek (64.158.138.xx) robot	Mozilla/4.7 (compatible; Intelliseek; http://www.intelliseek.com)
1403	OffByOne Browser	Mozilla/4.7 (compatible; OffByOne; Windows 98) Webster Pro V3.2
1404	WhizBang! Labs information extraction robot	Mozilla/4.7 (compatible; Whizbang)
1405	WhizBang! Labs information extraction robot	Mozilla/4.7 (compatible; WhizBang; http://www.whizbang.com/crawler)
1406	BecomeBot - Becomecom shopping search (64.124.85.xx(x))	Mozilla/4.7 [en](BecomeBot@exava.com)
1407	Exabot - exava shopping search (64.124.85.xx(x))	Mozilla/4.7 [en](Exabot@exava.com)
1408	unknown	Mozilla/4.7 [en]C-CCK-MCD {Yahoo;YIP052400} (Win95; I)
1409	http://www.ba.be robot	Mozilla/4.72 [en] (BACS http://www.ba.be)
1410	Netscpape 4.7x Caldera Open Linux Pentium III	Mozilla/4.72C-CCK-MCD Caldera Systems OpenLinux [en] (X11; U; Linux 2.2.14 i686)
1411	Netscape 4.7x Japan OSF1 alpha	Mozilla/4.75C-ja [ja] (X11; U; OSF1 V5.1 alpha)
1412	Opera 5.x Win 98	Mozilla/4.76 (Windows 98; U) Opera 5.12 [en]
1413	Netscape 4.7x FreeBSD	Mozilla/4.76 [en] (X11; U; FreeBSD 4.4-STABLE i386)
1414	Netscape 4.7x SunOS	Mozilla/4.76 [en] (X11; U; SunOS 5.7 sun4u)
1415	IRIX 6.5	Mozilla/4.77C-SGI [en] (X11; U; IRIX 6.5 IP32)
1416	GigaMedia / NTT DoCoMo robot	Mozilla/5.0
1417	Eurekster Swicki community search using SLI-Systems site search engine Mammoth	Mozilla/5.0 (+http://www.eurekster.com/mammoth) Mammoth/0.1
1418	SLI Systems mammoth robot	Mozilla/5.0 (+http://www.sli-systems.com/) Mammoth/0.1
1419	Clush search robot	Mozilla/5.0 (Clustered-Search-Bot/1.0; support@clush.com; http://www.clush.com/)
1420	Greasemonkey RSS panel Firefox plugin	Mozilla/5.0 (compatible) GM RSS Panel X
1421	Evri search robot	Mozilla/5.0 (compatible; +http://www.evri.com/evrinid)
1422	008 distributed crawler for 80legs	Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620
1423	Abonti WebSearch beta robot	Mozilla/5.0 (compatible; Abonti/0.8 - http://www.abonti.com)
1424	HitCompanies Aihit crawler	Mozilla/5.0 (compatible; aiHitBot/1.0; +http://www.aihit.com/)
1425	Ansearch Australian search robot	Mozilla/5.0 (compatible; AnsearchBot/1.x; +http://www.ansearch.com.au/)
1426	The Library of Congress Minerva crawler	Mozilla/5.0 (compatible; archive.org_bot/1.10.0 +http://www.loc.gov/minerva/crawl.html)
1427	Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx)	Mozilla/5.0 (compatible; archive.org_bot/1.13.1x http://crawler.archive.org)
1428	Heritrix - The Internet Archive's open-source crawler	Mozilla/5.0 (compatible; archive.org_bot/1.5.0-200506132127 http://crawler.archive.org) Hurricane Katrina
1429	Ask Jeeves /Teoma robot	Mozilla/5.0 (compatible; Ask Jeeves/Teoma; http://about.ask.com/en/docs/about/webmasters.shtml)
1430	Project BanBots Perl script robot	Mozilla/5.0 (compatible; BanBots/2.0b; Fetch; +http://www.banbots.com)
1431	BecomeBot - Become.com shopping search (64.124.85.xx(x))	Mozilla/5.0 (compatible; BecomeBot/1.23; http://www.become.com/webmasters.html)
1432	BecomeBot - Become.com shopping search (64.124.85.xx(x))	Mozilla/5.0 (compatible; BecomeBot/1.xx; MSIE 6.0 compatible; http://www.become.com/webmasters.html)
1433	BecomeBot - Become.com shopping search (64.124.85.xx(x))	Mozilla/5.0 (compatible; BecomeBot/2.0beta; http://www.become.com/webmasters.html)
1434	BecomeBot - Become.com shopping search (64.124.85.xx(x))	Mozilla/5.0 (compatible; BecomeBot/2.x; MSIE 6.0 compatible; http://www.become.com/site_owners.html)
1435	BecomeBot - Become.com shopping search (64.124.85.xx(x))	Mozilla/5.0 (compatible; BecomeJPBot/2.3; MSIE 6.0 compatible; +http://www.become.co.jp/site_owners.html)
1436	BlogRefsBot.com blog robot	Mozilla/5.0 (compatible; BlogRefsBot/0.1; http://www.blogrefs.com/about/bloggers)
1437	Pressemitteilungen Webservice RSS / news crawler (Germany)	Mozilla/5.0 (compatible; Bot; +http://pressemitteilung.ws/spamfilter
1438	BuzzRanking internet content analysis	Mozilla/5.0 (compatible; BuzzRankingBot/1.0; +http://www.buzzrankingbot.com/)
1439	Charlotte indexing spider for Searchme / Wikiseek	Mozilla/5.0 (compatible; Charlotte/1.0b; charlotte@betaspider.com)
1440	Charlotte indexing spider for Searchme / Wikiseek	Mozilla/5.0 (compatible; Charlotte/1.0b; http://www.searchme.com/support/)
1441	Unknown graphics crawler or downloading agent from Yamana Laboratory - Waseda Univerity Japan (133.9.238.xx)	Mozilla/5.0 (compatible; Crawling jpeg; http://www.yama.info.waseda.ac.jp)
1442	Custo web site spidering tool (link checking)	Mozilla/5.0 (compatible; Custo 3 (Netwu.com); Windows NT 5.1)
1443	De.com German travel related search via Amazon Web Services	Mozilla/5.0 (compatible; de/1.13.2 +http://www.de.com)
1444	Diffbot beta - RSS and news feed crawler	Mozilla/5.0 (compatible; Diffbot/0.1; +http://www.diffbot.com)
1445	DNS-Digger - DNS server neighbourhood search	Mozilla/5.0 (compatible; DNS-Digger-Explorer/1.0; +http://www.dnsdigger.com)
1446	DNS-Digger - DNS server neighbourhood search	Mozilla/5.0 (compatible; DNS-Digger/1.0; +http://www.dnsdigger.com)
1447	Earthcom (Czech Republic) search robot (194.108.39.xx)	Mozilla/5.0 (compatible; EARTHCOM.info/2.01; http://www.earthcom.info)
1448	enter4u / Earthcom.info search (Czech Republic)	Mozilla/5.0 (compatible; EARTHCOM/2.2; +http://enter4u.eu)
1449	Prague Faculty of Mathematics and Physics using Egothor open source crawler	Mozilla/5.0 (compatible; egothor/8.0g; +http://ego.ms.mff.cuni.cz/)
1450	Exalead (France) search robot (193.47.80.xx)	Mozilla/5.0 (compatible; Exabot Test/3.0; +http://www.exabot.com/go/robot)
1451	TheFind.com - Shopping search robot	Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/main/CrawlerFAQs.fhtml)
1452	Galbot tagging robot (beta) - Denmark	Mozilla/5.0 (compatible; Galbot/1.0; +http://www.galbot.com/bot.html)
1453	Geneva Single-Site Search Engine used by Healthdash health search	mozilla/5.0 (compatible; genevabot http://www.healthdash.com)
1454	Paros - a Java based HTTP/HTTPS proxy	Mozilla/5.0 (compatible; Google Desktop) Paros/3.2.12
1455	Google robot	Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1456	Unknown robot using Heritrix	mozilla/5.0 (compatible; heritrix/1.0.4 http://innovationblog.com)
1457	The Stanford University InfoLab robot using Heritrix	Mozilla/5.0 (compatible; heritrix/1.10.2 +http://i.stanford.edu/)
1458	Newstin news feed search using Heritrix	Mozilla/5.0 (compatible; heritrix/1.12.1 +http://newstin.com/)
1459	Page-store.com vertical search via Amazon Web Services	Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com)
1460	Page-store.com vertical search via Amazon Web Services	Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com) [email:paul@page-store.com]
1461	Heritrix Internet Archive's open-source web project	mozilla/5.0 (compatible; heritrix/1.3.0 http://archive.crawler.org)
1462	Chepi Beta search Spain (194.116.240.1xx) using Heritrix	Mozilla/5.0 (compatible; heritrix/1.4.0 +http://www.chepi.net)
1463	Truveo data mining robot using Heritrix	Mozilla/5.0 (compatible; heritrix/1.4t http://www.truveo.com/)
1464	L3S WebCrawling Project (Germany) using Heritrix	Mozilla/5.0 (compatible; heritrix/1.5.0 http://www.l3s.de/~kohlschuetter/projects/crawling/)
1465	Pandora Internet Archive crawler (Australia) using Heritrix	Mozilla/5.0 (compatible; heritrix/1.5.0-200506231921 http://pandora.nla.gov.au/crawl.html)
1466	WORIO (beta) search for computer scientists and programmers using Heritrix open-source crawler	Mozilla/5.0 (compatible; heritrix/1.6.0 http://www.worio.com/)
1467	greatarea.com website collection project using Heritrix	Mozilla/5.0 (compatible; heritrix/1.7.0 +http://www.greaterera.com/)
1468	hanzo:web social web archiving service	Mozilla/5.0 (compatible; Heritrix/1.8.0 http://www.hanzoarchives.com)
1469	Accelobot - Accelovation Market Discovery software robot	Mozilla/5.0 (compatible; heritrix/1.x.x +http://www.accelobot.com)
1470	Unknown AOL robot using Heritrix	Mozilla/5.0 (compatible; heritrix/2.0.0-RC1 +http://www.aol.com)
1471	Hermits Search.com - Products and service search robot	Mozilla/5.0 (compatible; Hermit Search. Com; +http://www.hermitsearch.com)
1472	IsMySiteUp? - Online website monitoring service	Mozilla/5.0 (compatible; http://www.IsMySiteUp.Net/bot/ )
1473	UptimeAuditor - real time web monitoring	Mozilla/5.0 (compatible; http://www.UptimeAuditor.com/bot/ )
1474	Hyperix vertical search crawler	Mozilla/5.0 (compatible; HyperixScoop/1.3; +http://www.hyperix.com)
1475	Unknown robot (reads robots.txt) from chinatelecom (219.142.78.xx)	Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)
1476	ID-Search.org - Russian search project	Mozilla/5.0 (compatible; IDBot/1.0; +http://www.id-search.org/bot.html)
1477	Najdi.si (Slovenia) search using Interseek/Web Interseek/API Search Engine	Mozilla/5.0 (compatible; InterseekWeb/3.x)
1478	hanzo:web social web archiving service	Mozilla/5.0 (compatible; Jim +http://www.hanzoarchives.com)
1479	Konqueror 2.0.x X11	Mozilla/5.0 (compatible; Konqueror/2.0.1; X11); Supports MD5-Digest; Supports gzip encoding
1480	Konqueror 2.1.x X11	Mozilla/5.0 (compatible; Konqueror/2.1.1; X11)
1481	Konqueror 2.2.x	Mozilla/5.0 (compatible; Konqueror/2.2.2)
1482	Konqueror 2.2.x Linux	Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux 2.4.14-xfs; X11; i686)
1483	Exalead (France) search robot (193.47.80.xx)	Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)
1484	Lemur Consulting LemIR spider	Mozilla/5.0 (compatible; LemSpider 0.1)
1485	Linksmanager.com online link checking service	Mozilla/5.0 (compatible; LinksManager.com_bot http://linksmanager.com/linkchecker.html)
1486	LinkStash Bookmark Manager	Mozilla/5.0 (compatible; LinkStash Bookmark Manager; http://www.xrayz.co.uk/)
1487	Mojeek Search Preview robot (217.155.205.xx)	Mozilla/5.0 (compatible; MojeekBot/2.0; http://www.mojeek.com/bot.html)
1488	Joomla!/Mambo component - MosBookmarks (bot) link checking	Mozilla/5.0 (compatible; MOSBookmarks/v2.6-Plus; Link Checker)
1489	PodTech entertainment and video network crawler	Mozilla/5.0 (compatible; MSIE 6.0; Podtech Network; crawler_admin@podtech.net)
1490	onet.pl Szukaj (Search) robot (213.180.128.1xx)	Mozilla/5.0 (compatible; OnetSzukaj/5.0; http://szukaj.onet.pl)
1491	Pagestacker online bookmark service	Mozilla/5.0 (compatible; PagestackerBot; http://www.pagestacker.com)
1492	PalmeraBot - Links24h.com search engine robot	Mozilla/5.0 (compatible; PalmeraBot; http://www.links24h.com/help/palmera) Version 0.001
1493	FeedMo feed search (Japan) using Pear HTTP	Mozilla/5.0 (compatible; PEAR HTTP_Request class; http://feed.moo.jp/)
1494	PHONifier mobile access to web content	Mozilla/5.0 (compatible; Phonifier; +http://www.phonifier.com)
1495	pmoz.info ODP link checking bot	Mozilla/5.0 (compatible; pmoz.info ODP link checker; +http://pmoz.info/doc/botinfo.htm)
1496	Pogodak search (Slovenia) robot via Interseek	Mozilla/5.0 (compatible; pogodak.ba/3.x)
1497	Pogodak search (Slovenia) robot via Interseek	Mozilla/5.0 (compatible; Pogodak.hr/3.1)
1498	Proximic Publisher Widget - RSS and news content generator	Mozilla/5.0 (compatible; Proximic crawler; +http://www.proximic.com/en/about-us/contact-us.html)
1499	ProgramacionWeb.net PWeBot crawler (Argentina)	Mozilla/5.0 (compatible; PWeBot/3.1; http://www.programacionweb.net/robot.php)
1500	Quantcast - Open Internet Ratings Service	Mozilla/5.0 (compatible; Quantcastbot/1.0; www.quantcast.com)
1501	robtex - Multi-RBL check and AS-numbercheck	Mozilla/5.0 (compatible; robtexbot/1.0; http://www.robtex.com/ )
1502	ScoutJet (Blekko) search web crawler	Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
1503	Scrub the web robot (66.93.156.xx)	Mozilla/5.0 (compatible; Scrubby/2.2; http://www.scrubtheweb.com/)
1504	Shunixbot (France) beta / test semantic web indexing robot	Mozilla/5.0 (compatible; ShunixBot/1.x.x +http://www.shunix.com/robot.htm)
1505	Shunixbot (France) beta / test semantic web indexing robot	Mozilla/5.0 (compatible; ShunixBot/1.x; http://www.shunix.com/bot.htm)
1506	Skreemr - Audio search engine	Mozilla/5.0 (compatible; SkreemRBot +http://skreemr.com)
1507	Snap Firefox Search Plugin	Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9
1508	Spurl.net bookmark service & search engine (84.40.30.xxx)	Mozilla/5.0 (compatible; SpurlBot/0.2)
1509	Summize - Opinion and review search robot	Mozilla/5.0 (compatible; SummizeBot +http://www.summize.com)
1510	Syclik Control web content management system	Mozilla/5.0 (compatible; SYCLIKControl/LinkChecker;)
1511	Synoo web directory robot	Mozilla/5.0 (compatible; Synoobot/0.9; http://www.synoo.com/search/bot.html)
1512	Theophrastus Internet Spider for a basic search engine project	Mozilla/5.0 (compatible; Theophrastus/x.x; http://users.cs.cf.ac.uk/N.A.Smith/theophrastus.php)
1513	Interseek - Java search engine technology used for Pogodak search	Mozilla/5.0 (compatible; TridentSpider/3.1)
1514	WiseGuys robot	Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
1515	Webdunia search (India) robot	Mozilla/5.0 (compatible; Webduniabot/1.0; +http://search.webdunia.com/bot.aspx)
1516	phpwebbrain online bookmark service (Germany)	Mozilla/5.0 (compatible; Windows NT 5.0; phpwebbrainBot/0.1 - http://www.monsterli.ch/phpwebbrain/)
1517	WORIO (beta) search for computer scientists and programmers using Heritrix open-source crawler	Mozilla/5.0 (compatible; worio bot heritrix/1.10.0 +http://worio.com)
1518	Kathune spider for World of Warcraft guild data. Used to power WoW Lemmings	Mozilla/5.0 (compatible; WoW Lemmings Kathune/2.0;http://www.wowlemmings.com/kathune.html)
1519	eXternalTest - Server and online services monitoring	Mozilla/5.0 (compatible; XTbot/1.0v; +http://www.externaltest.com)
1520	Yahoo / Inktomi search robot	Mozilla/5.0 (compatible; Yahoo! DE Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
1521	Inktomi robot (202.160.180.xxx) for Yahoo China	Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
1522	Inktomi robot for Yahoo (via 66.196.xx.xxx)	Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
1523	Yesup Seo - Toronto SEO Service	Mozilla/5.0 (compatible; YesupBot/1.0; +http://www.yesup.net/bot.html)
1524	Yoono - community based search (193.110.140.xxx / 194.0.179.[x]xx)	Mozilla/5.0 (compatible; Yoono; http://www.yoono.com/)
1525	Youdao search (China) robot	Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
1526	Zenbot robot for the Southern African Zen search service	Mozilla/5.0 (compatible; Zenbot/1.3; +http://zen.co.za/webmasters/)
1527	Powerset Natural Language Search crawler (under development) using Heritrix via Amazon Web Services	Mozilla/5.0 (compatible; zermelo +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com]
1528	Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx)	Mozilla/5.0 (compatible;archive.org_bot/1.7.1; collectionId=316; Archive-It; +http://www.archive-it.org)
1529	Wayback Machine Internet Archive crawler	Mozilla/5.0 (compatible;archive.org_bot/heritrix-1.9.0-200608171144 +http://pandora.nla.gov.au/crawl.html)
1530	FindITAnswers - Search engine for software developers	Mozilla/5.0 (compatible;FindITAnswersbot/1.0;+http://search.it-influentials.com/bot.htm)
1531	Mainseek search (Poland) robot	Mozilla/5.0 (compatible;MAINSEEK_BOT)
1532	MozShot - Technical demo to take screenshot of any URL	Mozilla/5.0 (Gecko/20070310 Mozshot/0.0.20070628; http://mozshot.nemui.org/)
1533	Mozilla Firefox 3.0 beta (Gran Paradiso) for MacOS	Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b5) Gecko/2008032619 Firefox/3.0b5
1534	Chimera browser (Mozilla/Gecko engine) - now Camino Mac PowerPC	Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.0.1) Gecko/20021219 Chimera/0.6
1535	Camino browser (Mozilla/Gecko engine) - ex Chimera Mac PowerPC	Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.0.1) Gecko/20030306 Camino/0.7
1536	OmniWeb 5.x.x Mac OS X browser	Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-US) AppleWebKit/xx (KHTML like Gecko) OmniWeb/v5xx.xx
1537	Safari 1.2x browser (Mozilla/Gecko engine) MAC OS X	Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/xxx.x (KHTML like Gecko) Safari/12x.x
1538	Netscape 6.x Mac PowerPC	Mozilla/5.0 (Macintosh; U; PPC; en-US; rv:0.9.2) Gecko/20010726 Netscape6/6.1
1539	unknown robot from gw.ocg-corp.com	Mozilla/5.0 (research@mediatrec.com)
1540	Sage - RSS and Atom feed reader extension for Mozilla Firefox	Mozilla/5.0 (Sage)
1541	Inktomi (Hotbot-Lycos - NBCi etc.) robot	Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
1542	Inktomi (Hotbot-Lycos - NBCi etc.) robot	Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
1543	Opera 5.x SunOS	Mozilla/5.0 (SunOS 5.8 sun4u; U) Opera 5.0 [en]
1544	Twiceler experimental web crawler	Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html)
1545	Some spambot from Romania (82.208.139.1xx & 86.123.65.xx) - Maybe email harvesting	Mozilla/5.0 (Version: xxxx Type:xx)
1546	GenieKnows.com search robot (64.5.245.xx / 64.5.220.xxx)	Mozilla/5.0 (wgao@genieknows.com)
1547	Netscape 6.x Win98	Mozilla/5.0 (Windows; U; Win98; en-US; rv:0.9.2) Gecko/20010726 Netscape6/6.1
1548	Firebird browser (Mozilla/Gecko engine) - ex Phoenix Win98	Mozilla/5.0 (Windows; U; Win98; en-US; rv:x.xx) Gecko/20030423 Firebird Browser/0.6
1549	Beonex Communicator browser (Mozilla/Gecko engine)	Mozilla/5.0 (Windows; U; Win9x; en; Stable) Gecko/20020911 Beonex/0.8.1-stable
1550	Healthline health related search robot (72.5.115.xx)	Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.7) NimbleCrawler 1.11 obeys UserAgent NimbleCrawler For problems contact: crawler_at_dataalchemy.com
1551	Google Chrome browser based on WebKit (Safari)	Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/525.19 (KHTML, like Gecko) Chrome/0.2.153.1 Safari/525.19
1552	Flock web browser built on Mozilla technologies	Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.5) Gecko/20060731 Firefox/1.5.0.5 Flock/0.7.4.1
1553	Megaupload Mega Manager - Download manager plugin for Firefox	Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.4/Megaupload x.0
1554	Orca browser - based on Gecko	Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008092215 Firefox/3.0.1 Orca/1.1 beta 3
1555	Firefox browser (Mozilla/Gecko engine) - ex Firebird WinXP	Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.x.x) Gecko/20041107 Firefox/x.x
1556	Firebird browser (Mozilla/Gecko engine) - ex Phoenix WinXP	Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.xx) Gecko/20030504 Mozilla Firebird/0.6
1557	Mnenhy - enhanced mail & news Mozilla based browser	Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.xxx) Gecko/20041027 Mnenhy/0.6.0.104
1558	Voila.fr robot	Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)
1559	Voila.fr robot	Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)
1560	Mozilla Firefox 3.0 beta (Gran Paradiso) for Win	Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b5) Gecko/2008032620 Firefox/3.0b5
1561	Tiscali Communicator - Online services suite	Mozilla/5.0 (Windows; U;XMPP Tiscali Communicator v.10.0.1; Windows NT 5.1; it; rv:1.8.1.3) Gecko/20070309 Firefox/2.0.0.3
1562	Healthline health related search robot (72.5.115.xx)	Mozilla/5.0 (Windows;) NimbleCrawler 1.12 obeys UserAgent NimbleCrawler For problems contact: crawler@health
1563	Healthline health related search robot (72.5.115.xx)	Mozilla/5.0 (Windows;) NimbleCrawler 1.12 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com
1564	Kazehakase - Gecko based browser (Japan)	Mozilla/5.0 (X11; Linux i686; U;rv: 1.7.13) Gecko/20070322 Kazehakase/0.4.4.1
1565	Netscape 6.x Linux	Mozilla/5.0 (X11; U; Linux 2.4.2-2 i586; en-US; m18) Gecko/20010131 Netscape6/6.01
1566	SeaMonkey browser suite (ex Mozilla) on Linux	Mozilla/5.0 (X11; U; Linux i686; de-AT; rv:1.8.0.2) Gecko/20060309 SeaMonkey/1.0
1567	Epiphany (Mozilla/Gecko engine) browser Linux	Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.7.6) Gecko/20050405 Epiphany/1.6.1 (Ubuntu) (Ubuntu package 1.0.2)
1568	Nautilus (developed by Eazel.com) 1.x Browser Linux	Mozilla/5.0 (X11; U; Linux i686; en-US; Nautilus/1.0Final) Gecko/20020408
1569	Mozilla (Gecko) 0.9x browser Linux	Mozilla/5.0 (X11; U; Linux i686; en-US; rv:0.9.3) Gecko/20010801
1570	Spinn3r social network crawler	Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130
1571	Phoenix 0.3 browser (Mozilla/Gecko engine) - now Firebird Linux	Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2b) Gecko/20021007 Phoenix/0.3
1572	Epiphany (Mozilla/Gecko engine) browser Linux	Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.6) Gecko/20040413 Epiphany/1.2.1
1573	Snap Firefox Search Plugin	Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 SnapPreviewBot
1574	Bon Echo Alpha - developer preview of future Firefox browser	Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1) Gecko/20061129 BonEcho/2.0
1575	IceWeasel - the GNU version of the Firefox browser	Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1) Gecko/20061205 Iceweasel/2.0.0.1 (Debian-2.0.0.1+dfsg-2)
1576	Mozilla Firefox 3.0 beta (Gran Paradiso) for Linux	Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9a8) Gecko/2007100619 GranParadiso/3.0a8
1577	Galeon 1.x Browser Linux	Mozilla/5.0 Galeon/1.0.2 (X11; Linux i686; U;) Gecko/20011224
1578	gURLChecker - GNOME link checking tool	Mozilla/5.0 gURLChecker/0.x.x (Linux)
1579	URL Spider - used by usww.net	Mozilla/5.0 URL-Spider
1580	W8net spider	Mozilla/5.0 usww.com-Spider-for-w8.net
1581	GenieKnows.com search robot (64.5.245.xx / 64.5.220.xxx)	Mozilla/5.0 wgao@genieknows.com
1582	axxus.de German business directory	Mozilla/5.0 whoiam [http://www.axxus.de/]
1583	Yuntis : Collaborative Web Resource Categorization and Ranking Project robot	Mozilla/5.0 [en] (compatible; Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)
1584	MetaExplorer project's MetaQuerier robot	MQbot metaquerier.cs.uiuc.edu/crawler
1585	MetaExplorer project's MetaQuerier robot	MQBOT/Nutch-0.9-dev (MQBOT Nutch Crawler; http://falcon.cs.uiuc.edu; mqbot@cs.uiuc.edu)
1586	MS Frontpage 4.x	MSFrontPage/4.0
1587	Some faked UA - maybe for a download manager	MSIE 4.0 (Win95)
1588	unknown robot from gw.ocg-corp.com (209.126.176.x)	MSIE-5.13 (larbin@unspecified.mail)
1589	MSN media search robot	msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
1590	Windows Live product search (Beta) robot	msnbot-Products/1.0 (+http://search.msn.com/msnbot.htm)
1591	MSN Search robot - 131.107.xxx.xxx 204.95.96.xxx - 204.95.111.xxx 207.46.xxx.xxx	MSNBOT/0.xx (http://search.msn.com/msnbot.htm)
1592	MSN Search robot - 131.107.xxx.xxx 204.95.96.xxx - 204.95.111.xxx 207.46.xxx.xxx	msnbot/x.xx ( http://search.msn.com/msnbot.htm)
1593	Microsoft search for mobiles	MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)
1594	MSN Search robot - 131.107.xxx.xxx 204.95.96.xxx - 204.95.111.xxx 207.46.xxx.xxx	MSNPTC/1.0
1595	Microsoft proxy server	MSProxy/2.0
1596	MacEdition CodeBitch link checking	MSRBOT
1597	Microsoft MSRBot	MSRBOT (http://research.microsoft.com/research/sv/msrbot)
1598	StreamBox VCR user agent	Mulder, VCR-1.0
1599	Multiblocker (Fantomaster) anonymity software user	multiBlocker browser
1600	MultiCrawler for DERI Galway's Semantic Web Search Engine cluster	multicrawler ( http://sw.deri.org/2006/04/multicrawler/robots.html)
1601	Virginia Tech Digital Library Research Laboratory robot	MultiText/0.1
1602	SoMusical! musical directory link checking	MusicWalker2.0 ( http://www.somusical.com)
1603	Unknown bad bot from diff. Taiwanese IPs	MVAClient
1604	Windows HTTP Services (WinHTTP)	My WinHTTP Connection
1605	unknown user robot (24.124.34.42)	myDaemon
1606	GetRight download manager	MyGetRight/1.0.0
1607	GetRight download manager	MyGetRight/1.0b
1608	Mylinea France web catalogue crawler	Mylinea.com Crawler 2.0
1609	VDOG - SEO webdirecory (Germany) link checking	mylinkcheck/1.02
1610	Blogbot (Germany) robot	Naamah 1.0.1/Blogbot (http://blogbot.de/)
1611	Blogbot (Germany) robot	Naamah 1.0a/Blogbot (http://blogbot.de/)
1612	Naver Japan / Korea robot	NABOT/5.0
1613	Naver Japan / Korea robot	nabot_1.0
1614	Badbot searching for Wordpress wp-login.php	NameOfAgent (CMS Spider)
1615	naoFavicon4IE	naoFavicon4IE/1.xx
1616	Unknown spambot / harvester from diff. IPs	NASA Search 1.0
1617	Nationaldirectory spider	NationalDirectory-WebSpider/1.3
1618	Nationaldirectory spider	NationalDirectoryAddURL/1.0
1619	Naver Japan / Korea robot	NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
1620	Naver Japan / Korea robot	NaverBot_dloader/1.5
1621	Navisso closed beta robot (69.41.162.1xx)	NavissoBot
1622	Navisso closed beta robot (69.41.162.1xx)	NavissoBot/1.7 (+http://navisso.com/)
1623	Vias Information Archival robot	NCSA Beta 1 (http://vias.ncsa.uiuc.edu/viasarchivinginformation.html)
1624	Nebulla.info distributed crawler (Germany)	Nebullabot/2.2 (http://bot.nebulla.info)
1625	NEC Researchindex robot - now CiteSeer.IST scientific document index	NEC Research Agent -- compuman at research.nj.nec.com
1626	rcn.com user agent ? NEC Researchindex robot ?	NEC-Hayek/1.0
1627	Net Seekr search robot	Net-Seekr Bot/Net-Seekr Bot V1 (http://www.net-seekr.com)
1628	NetAnts download manager	NetAnts/1.2x
1629	NetComplete IE browser package	NETCOMplete/x.xx
1630	Netinfo.bg search (Bulgaria) robot	NetinfoBot/1.0 (http://netinfo.bg/netinfobot.html)
1631	Netlookout internet notifier	NetLookout/2.24
1632	Netluchs (Germany) search (193.164.8.xx)	Netluchs/0.8-dev ( ; http://www.netluchs.de/; ___don't___spam_me_@netluchs.de)
1633	NetMechanic link checker	NetMechanic Vx.0
1634	NewsGator NetNewsWire - Mac RSS feed reader	NetNewsWire/2.x (Mac OS X; http://ranchero.com/netnewswire/)
1635	unknown InCom (216.0.107.xx) robot	NetNoseCrawler/v1.0
1636	Netprospector metasearch software	Netprospector JavaCrawler
1637	Netpumper download manager	NetPumper/x.xx
1638	Look.com robot (209.87.232.x)	NetResearchServer(http://www.look.com)
1639	IncyWincy search engine using DMOZ database	NetResearchServer/x.x(loopimprovements.com/robot.html)
1640	NetSeer search (beta) crawler via Amazon Web Services - see also Teemer	NetSeer/Nutch-0.9 (NetSeer Crawler; http://www.netseer.com; crawler@netseer.com)
1641	Wirtualna Polska / Netsprint search (Poland) robot	NetSprint -- 2.0
1642	NetWhat Search crawler (69.9.167.1xx)	NetWhatCrawler/0.06-dev (NetWhatCrawler from NetWhat.com; http://www.netwhat.com; support@netwhat.com)
1643	Netzippy robot	NetZippy
1644	unknown	NeuralBot/0.2
1645	Unknown (12.238.4.xxx) attbi.com client robot	newsearchengine (ThisUser@unspecified.mail)
1646	FetchLinks plugin for NewsGator RSS reader	NewsGator FetchLinks extension/0.2.0 (http://graemef.com)
1647	NewsGator online RSS reader	NewsGatorOnline/2.0 (http://www.newsgator.com; 1 subscribers)
1648	Eliyon Crawler for Business People Search	NextGenSearchBot 1 (for information visit http://www.eliyon.com/NextGenSearchBot)
1649	Nextopia crawler	NextopiaBOT (+http://www.nextopia.com) distributed crawler client beta v0.x
1650	find your keywords - semantic search (Germany) robot	NG-Search/0.90 (NG-SearchBot; http://www.ng-search.com; )
1651	Exalead (France) search robot (193.47.80.xx)	NG/1.0
1652	Exalead Websearch image crawler (193.47.80.xx)	NG/4.0.1229
1653	Unknown UA from PlanetLab distributed network	nicebot
1654	NicoZone childsafe search robot	NICO/1.0
1655	Nikita the Spider - Online HTML validation , link checking	Nikita the Spider (http://NikitaTheSpider.com/)
1656	Experimental LSI (?) robot from 140.233.69.xx (Middlebury.edu)	NITLE Blog Spider/0.01
1657	Download manager	Nitro Downloader 1.x (www.klsofttools.com)
1658	Noago spider	Noago Spider
1659	telefonica.es user robot	Nocilla/1.0
1660	Google WAP robot	Nokia-WAPToolkit/1.2 googlebot(at)googlebot.com
1661	Botmobi crawler for Find.mobi mobile search	Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi http://find.mobi/bot.html abuse@mtld.mobi)
1662	YahooSeeker/M1A1-R2D2 - Yahoo mobile web crawling robot	Nokia6610/1.0 (3.09) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html)
1663	Google WAP proxy	Nokia7110/1.0 (05.01) (Google WAP Proxy/1.0)
1664	Nokodo public beta search robot (67.18.222.xx)	NokodoBot/1.x (+http://nokodo.com/bot.htm)
1665	Burf.com UK Search Engine robot	Norbert the Spider(Burf.com)
1666	noXtrum search robot (Spain)	noxtrumbot/1.0 (crawler@noxtrum.com)
1667	Noyona job search (preview)	noyona_0_1
1668	Nameprotect copyright search robot (24.177.134.x)	NP/0.1 (NP; http://www.nameprotect.com; npbot@nameprotect.com)
1669	Nameprotect copyright search robot (24.177.134.x)	NPBot (http://www.nameprotect.com/botinfo.html)
1670	Nameprotect copyright search robot (24.177.134.x)	NPBot-1/2.0
1671	Nsauditor Network Security Auditor	Nsauditor/1.x
1672	NetShow Media Player = Windows Media Player 10	NSPlayer/10.0.0.xxxx WMFSDK/10.0
1673	Nsyght social search application	nsyght.com/Nutch-1.0-dev (nsyght.com; Nsyght.com)
1674	Nsyght social search application	nsyght.com/Nutch-x.x (nsyght.com; search.nsyght.com)
1675	NTT Directory robot	nttdirectory_robot/0.9 (super-robot@super.navi.ocn.ne.jp)
1676	Nucleus CMS SiteList link managing plugin	Nucleus SiteList LinkChecker/1.1
1677	nuSearch spider (84.9.136.xxx)	nuSearch Spider <a href='http://www.nusearch.com'>www.nusearch.com</a> (compatible; MSIE 4.01)
1678	nuSearch spider (84.9.136.xxx)	NuSearch Spider (compatible; MSIE 6.0)
1679	nuSearch spider (84.9.136.xxx)	NuSearch Spider www.nusearch.com
1680	Nutch open source robot	Nutch
1681	Picapage search for handheld devices using Nutch	Nutch crawler/Nutch-0.9 (picapage.com; admin@picapage.com)
1682	Ayell Euronet business directory robot using Nutch	Nutch/Nutch-0.9 (Eurobot; http://www.ayell.eu )
1683	Netsweeper content filtering engine (66.207.120.2xx) powered by Nutch	NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
1684	Nutch open source robot	NutchCVS/0.0x-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)
1685	Robot from University of Washington Computer Science & Engineering (128.208.6.2xx)	NutchCVS/0.7.1 (Nutch running at UW; http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu)
1686	Amazon Elastic Compute Cloud (Amazon EC2) robot	NutchEC2Test/Nutch-0.9-dev (Testing Nutch on Amazon EC2.; http://lucene.apache.org/nutch/bot.html; ec2test at lucene.com)
1687	Nutch open source robot	NutchOrg/0.0x-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)
1688	Unknown robot using Nutch (maybe private crawling) via Cox network (70.187.130.25x)	nutchsearch/Nutch-0.9 (Nutch Search 1.0; herceg_novi at yahoo dot com)
1689	Unknown crawler from University of Washington - Computer science	NutchVinegarCrawl/Nutch-0.8.1 (Vinegar; http://www.cs.washington.edu; eytanadar at gmail dot com)
1690	Weblog bookwatch robot	obidos-bot (just looking for books.)
1691	Objects Search robot	ObjectsSearch/0.01-dev (ObjectsSearch;http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)
1692	Objects Search robot	ObjectsSearch/0.0x (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)
1693	Cobion Germany Brand Protection Services robot	oBot ((compatible;Win32))
1694	GlobalSpec Engineering Search robot (66.194.55.xxx)	Ocelli/1.x (http://www.globalspec.com/Ocelli)
1695	Octopus download manager	Octopus
1696	Octora blog or RSS information crawler - beta (66.228.114.xx)	Octora Beta - www.octora.com
1697	Octora RSS feed search	Octora Beta Bot - www.octora.com
1698	Meta Products Offlinebrowser	Offline Explorer 1.*
1699	Claymont robot / Internetseer Web Site Monitoring	OliverPerry
1700	OmniExplorer car & shopping search (64.62.175.xxx)	OmniExplorer_Bot/1.0x (+http://www.omni-explorer.com) Internet CategorizerOmniExplorer http://www.omni-explorer.com/ car & shopping search (64.62.175.xxx)
1701	OmniExplorer car & shopping search (64.62.175.xxx)	OmniExplorer_Bot/1.0x (+http://www.omni-explorer.com) Job Crawler
1702	OmniExplorer car & shopping search (64.62.175.xxx)	OmniExplorer_Bot/1.1x (+http://www.omni-explorer.com) Torrent Crawler
1703	OmniExplorer car & shopping search (64.62.175.xxx)	OmniExplorer_Bot/x.xx (+http://www.omni-explorer.com) WorldIndexer
1704	onsearch.de German web directory link checking	onCHECK Linkchecker von www.scientec.de fuer www.onsinn.de
1705	onsearch.de German web directory link checking	onCHECK-Robot, www.onsearch.de
1706	onet.pl Szukaj (Search) robot (213.180.128.1xx)	Onet.pl SA- http://szukaj.onet.pl
1707	Dead-Links.com link validation spider	online link validator (http://www.dead-links.com/)
1708	Online24 shopping portal (Germany) link checking	Online24-Bot (Version: 1.0x, powered by www.online24.de)
1709	OntoSpider - Dutch robot for a research project. (195.11.244.xx)	OntoSpider/1.0 libwww-perl/5.65
1710	SeetooZ search crawler	OOZBOT/0.20 ( http://www.setooz.com/oozbot.html ; agentname at setooz dot_com )
1711	OpenAcoon open source search engine (used by Acoon search)	OpenAcoon v4.0.x (www.openacoon.de)
1712	Openfind.com.tw robot	Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
1713	Openfind.com.tw robot	Openfind data gatherer- Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
1714	Openfind.com.tw robot	Openfind Robot/1.1A2
1715	open i search robot - search engine in development	OpenISearch/1.x (www.openisearch.com)
1716	Opentagger social bookmarking system	OpenTaggerBot (http://www.opentagger.com/opentaggerbot.htm)
1717	OpenText crawler	OpenTextSiteCrawler/2.9.2
1718	OpenWebSpider - Open Source web search engine	OpenWebSpider/0.x.x (http://www.openwebspider.org)
1719	OpenWebSpider - Open Source web search engine	OpenWebSpider/x
1720	Opera 5.0 Linux	Opera/5.0 (Linux 2.0.38 i386; U) [en]
1721	Opera 5.11 faked WinME referer	Opera/5.11 (Windows ME; U) [ru]
1722	Opera 5.12 Win98	Opera/5.12 (Windows 98; U) [en]
1723	unknown robot from gw.ocg-corp.com (209.126.176.x)	Opera/6.01 (larbin@unspecified.mail)
1724	Opera 6.x- Mandrake Linux	Opera/6.x (Linux 2.4.8-26mdk i686; U) [en]
1725	Opera 6.x WinNT	Opera/6.x (Windows NT 4.0; U) [de]
1726	Opera 7.x WinXP	Opera/7.x (Windows NT 5.1; U) [en]
1727	Opera 8.x (Beta) WinXP	Opera/8.xx (Windows NT 5.1; U; en)
1728	Opera 9 (Beta) Browser	Opera/9.0 (Windows NT 5.1; U; en)
1729	Opera 9 (final)	Opera/9.00 (Windows NT 5.1; U; de)
1730	Opera browser 9.6x on WinXP (Presto = Operas rendering engine)	Opera/9.60 (Windows NT 5.1; U; de) Presto/2.1.1
1731	Opidoo Search Belgium robot (62.4.83.xxx)	OpidooBOT (larbin2.6.3@unspecified.mail)
1732	Open Wave Phone Simulator SDK	OPWV-SDK UP.Browser/7.0.2.3.119 (GUI) MMP/2.0 Push/PO
1733	Oracle Application Server cache	Oracle Application Server Web Cache 10g
1734	Oracle interMedia Text - Text and web documents indexing	Oracle iMTCrawler
1735	Oracle Search	Oracle Ultra Search
1736	Orangeslicer semantic search (Beta) Germany (193.201.52.1xx)	OrangeSpider
1737	Orbiter - DailyOrbit search spider	Orbiter/T-2.0 (+http://www.dailyorbit.com/bot.htm)
1738	Orca browser - based on Gecko	Orca Browser (http://www.orcabrowser.com)
1739	Marketscore (was Netsetter) internet accelerator	OSSProxy 1.3.305.321 (Build 305.321 Win32 en-us)(Dec 21 2005 16:30:54)
1740	Unknown robot from Chinanet (220.181.8.xxx)	OutfoxBot/0.x (For internet experiments; http://; outfox.agent@gmail.com)
1741	Unknown robot from Chinanet (60.191.80.1)	OutfoxMelonBot/0.5 (for internet experiments; http://; outfoxbot@gmail.com)
1742	Overture/Fast/Alltheweb crawler (66.77.73.xxx)	Overture-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
1743	Unknown robot from 198.169.127.xx (innovationplace.com)	OWR_Crawler 0.1
1744	Ozelot - Flying Cat's search engine robot (Germany)	ozelot/2.7.3 (Search engine indexer; www.flying-cat.de/ozelot; ozelot@flying-cat.de)
1745	PADLibrary.com - PAD file software robot for FindFiles.com	PADLibrary Spider
1746	Pagebites job search crawler	PageBitesHyperBot/600 (http://www.pagebites.com/)
1747	Pagebull visual search engine	Pagebull http://www.pagebull.com/
1748	Pagestacker online bookmark service	Pagestacker Bot
1749	Secure Computing SmartFilter Tools - malware crawler	page_verifier (http://www.securecomputing.com/goto/pv)
1750	Downloadmanager ?	PagmIEDownload
1751	CFC crawler used by Italian academic and research network (GARR)	parallelContextFocusCrawler1.1parallelContextFocusCrawler1.1
1752	http://www.ianett.com robot	ParaSite/1.0b (http://www.ianett.com/parasite/)
1753	Patsearch (Germany) robot	Patwebbot (http://www.herz-power.de/technik.html)
1754	Pavuk web downloading program for Unix	pavuk/0.9pl29b i686-pc-linux-gnu
1755	Some site scanning tool via diff. IPs- i.e.: - cox.net (68.4.xxx.xxx)	PBrowse 1.4b
1756	Post.sk / Eurotel.sk robot	pd02_1.0.0 pd02_1.0.0@dzimi@post.sk
1757	Pear HTTP_Request PHP extension package	PEAR HTTP_Request class ( http://pear.php.net/ )
1758	Peerbot - favicon search robot	PEERbot www.peerbot.com
1759	Unknown robot from 64.5.48.xxx (Plethoric.net)	PeopleChat/Search_Engine
1760	Some site scanning tool via diff. IPs	PEval 1.4b
1761	diff. IPs / services	PHP/3.x.xx
1762	diff. IPs / services	PHP/4.0.4pl1
1763	diff. IPs / services- i.e.: -NTT/Verio Inc. link checker	PHP/4.0.6
1764	diff. IPs / services- i.e.: - Phenominet.com link checking	PHP/4.1.1
1765	diff. IPs / services- i.e.: - 209.114.200.xx = MyNetCrawler link checking - 216.139.207.xxx = Mixcat crawler	PHP/4.1.2
1766	Pico Search robot	PicoSearch/1.0
1767	Piffany targeted search web spider	Piffany_Web_Scraper_v0.x
1768	Piffany targeted search web spider	Piffany_Web_Spider_v0.x
1769	Whois Source domain name information robot (66.249.26.xx)- s.also: - SurveyBot	PigeonBot1.0 BETA
1770	PingALink website monitoring	PingALink Monitoring Services 1.0
1771	PingALink website monitoring	PingALink Monitoring Services 1.0 (http://www.pingalink.com)
1772	Pingdom web site monitoring	Pingdom GIGRIB (http://www.pingdom.com)
1773	pipeline search (DMOZ based) search robot (24.106.39. xxx)	pipeLiner/0.3a (PipeLine Spider;http://www.pipeline-search.com/webmaster.html; webmaster'at'pipeline-search.com)
1774	pipeline search (DMOZ based) search robot (24.106.39. xxx)	pipeLiner/0.xx (PipeLine Spider; http://www.pipeline-search.com/webmaster.html)
1775	Pita crawler	Pita
1776	Private user-agent via Hurricane Electric Internet Services	Pizilla++ ver 2.45
1777	Portaljuice spider	PJspider/3.0 (pjspider@portaljuice.com; http://www.portaljuice.com)
1778	Plagger - pluggable RSS/Atom feed aggregator written in Perl	Plagger/0.x.xx (http://plagger.org/)
1779	unknown ucsd.edu robot	PlagiarBot/1.0
1780	Plantynet web filtering services - Blacklist DB robot	PlantyNet_WebRobot_V1.9 dhkang@plantynet.com
1781	Unknown UA from 66.220.23.2xx	plinki/0.1 (you got plinked! (thats a good thing..); http://www.plinki.com; crawl@plinki.com)
1782	Pluck RSS feed crawler	PluckFeedCrawler/2.0 (compatible; Mozilla 4.0; MSIE 5.5; http://www.pluck.com; 1 subscribers)
1783	Pluggd Podcast search engine	Pluggd/Nutch-0.9 (automated crawler http://www.pluggd.com;support at pluggd dot com)
1784	Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan	Pockey-GetHTML/4.12.0 (Win32; GUI; ix86)
1785	Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan	Pockey-GetHTML/x.xx
1786	Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan	Pockey/x.x.x
1787	Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan	Pockey7.x.x(WIN32GUI)
1788	HTTP user-agent for POE (portable networking framework for Perl )	POE-Component-Client-HTTP/0.64 (perl; N; POE; en; rv:0.640000)
1789	ThePlanet/jaja-jak-globusy.com Google Adsense refferer spam bot from 70.85.116.* / 70.84.128.xxx / 70.85.193.xxx	Poirot
1790	Polybot webcrawler	polybot 1.0 (http://cis.poly.edu/polybot/)
1791	Dir.com / Iliad French recherche robot	Pompos/1.x http://dir.com/pompos.html
1792	Iliad / Free French recherche robot	Pompos/1.x pompos@iliad.fr
1793	Popdex - web site popularity crawler	Popdexter/1.0
1794	Unknown spam bot / harvester (63.223.10.***)	Port Huron Labs
1795	PortalB (now Alacra search) spider	PortalBSpider/2.0 (spider@portalb.com)
1796	portalmmm IMode mobile browser	portalmmm/2.0 S500i(c20;TB)
1797	Yahoo (66.94.237.1xx / 216.109.121.xx) favorites tracking robot	PostFavorites
1798	Potbot : A simple IRC bot written in Perl	potbot 1.0
1799	Project Rialto - data mining development project	PRCrawler/Nutch-0.9 (data mining development project; crawler@projectrialto.com)
1800	CUPS robot for AT&T Privacy Bird Privacy Preferences (P3P) enhancements	PrivacyFinder Cache Bot v1.0
1801	CUPS robot for AT&T Privacy Bird Privacy Preferences (P3P) enhancements	PrivacyFinder/1.1
1802	Privoxy web proxy	Privoxy/3.0 (Anonymous)
1803	Some site scanning tool from diff. IPs- i.e.: - 67.99.33.x (lightningcon.broadwing.net)	Production Bot 0116B
1804	Some site scanning tool from diff. IPs- i.e.: - 216.232.64.xx (telus.net)	Production Bot 2016B
1805	Some site scanning tool from diff. IPs- i.e.: - 141.154.181.xxx (east.verizon.net)	Production Bot DOT 3016B
1806	Some spam bot	Program Shareware 1.0.2
1807	unknown	Progressive Download
1808	unknown	Progressive Download HTTP check
1809	XP5 robot	Project XP5 [2.03.07-111203]
1810	Answerchase PROve Answerbot	PROve AnswerBot 4.0
1811	ProWebguide robot	ProWebGuide Link Checker (http://www.prowebguide.com)
1812	Picsearch robot (62.119.21.13x)	psbot/0.1 (+http://www.picsearch.com/bot.html)
1813	Some site scanning tool via diff. IPs- i.e.: QWest Net	PSurf15a 11
1814	Some site scanning tool via diff. IPs- i.e.: Optonline net (24.191.xxx.xxx)	PSurf15a 51
1815	Some site scanning tool via diff. IPs- i.e.: - choiceone.net (216.153.xxx.xxx) - attbi.com (12.250.xxx.xxx) - optonline.net (24.191.xxx.xxx)	PSurf15a VA
1816	Unknown website grabbing / ripping for unknown purposes from 208.66.195.x - Digitalinfinity.org Russia	psycheclone
1817	Some robot from Stanford University (171.64.75.xxx = PubCrawl.Stanford.EDU)	PubCrawl (pubcrawl.stanford.edu)
1818	Parallel URL Fetcher downloading tool	puf/0.91beta6a (Linux 2.2.18; i686)
1819	Parallel URL Fetcher downloading tool	puf/0.93.2a (Linux 2.4.18; i686)
1820	WebarooBot - Webaroo web site search / theme based downloading tool (64.124.122.2xx)	pulseBot (pulse Web Miner)
1821	PureSight Internet content filter	PureSight
1822	Puxa Rapido download manager	PuxaRapido v1.0
1823	ProgramacionWeb.net PWeBot link checking (Argentina)	PWeBot/1.2 Inspector (http://www.programacionweb.net/robot.php)
1824	Fast Search robot (using PycURL Python component- s. below)	PycURL
1825	PycURL - Python interface to libcurl	PycURL/7.xx.x
1826	Python URL fetcher - robot used by Naver Japan/Korea	Python-urllib/1.1x
1827	Python URL fetcher - robot used by Google	Python-urllib/2.0a1
1828	Qango.com Web Directory robot	Qango.com Web Directory (http://www.qango.com/)
1829	QEAVis: Quantitative Evaluation of Academic Websites Visibility using Nutch	QEAVis Agent/Nutch-0.9 (Quantitative Evaluation of Academic Websites Visibility; http://nlp.uned.es/qeavis
1830	Quepasa!com (Latin American search) robot	QPCreep Test Rig ( We are not indexing- just testing )
1831	Quepasa!com (Latin American search) robot	QuepasaCreep ( crawler@quepasacorp.com )
1832	Quepasa!com (Latin American search) robot	QuepasaCreep v0.9.1x
1833	QueryN Metasearch robot	QueryN Metasearch
1834	Blacktrees Quicksilver helper application for Mac	Quicksilver (Blacktree,MacOSX)
1835	Quicktime for Macintosh	QuickTime\xaa.7.0.4 (qtver=7.0.4;cpu=PPC;os=Mac 10.3.9)
1836	Qweerybot for the Qweery search engine (in development) - Netherland	QweeryBot/3.01 ( http://qweerybot.qweery.nl)
1837	Qweerybot for the Qweery search engine (in development) - Netherland	Qweery_robot.txt_CheckBot/3.01 (http://qweerybot.qweery.com)
1838	Radian6 RSS feed comment crawler	R6_CommentReader_(www.radian6.com/crawler)
1839	Radian6 Rss feed crawler	R6_FeedFetcher_(www.radian6.com/crawler)
1840	gigaBaz - the brainbot (Germany) robot	rabaz (rabaz at gigabaz dot com)
1841	DAUMOA - Daum search Korea robot (211.115.109.xxx)	RaBot/1.0 Agent-admin/phortse@hanmail.net
1842	Bot Provider for the All Womans Bot Service?	Rainbot1.1
1843	Intersearch.de (was www.intersearch.de) robot (Germany)	ramBot xtreme x.x
1844	giveRAMP Search Engine robot (64.69.43.1xx)	RAMPyBot - www.giveRAMP.com/0.1 (RAMPyBot - www.giveRAMP.com; http://www.giveramp.com/bot.html; support@giveRAMP.com)
1845	giveRAMP Search Engine robot (64.69.43.1xx)	RAMPyBot/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)
1846	Rank Exec reciprocal link checking	Rank Exec (rankexec.com) Reciprocal Link Manager 1.x/bot
1847	Rankiva website popularity robot	Rankivabot/3.2 (www.rankiva.com; 3.2; vzmxikn)
1848	Innova/IBM Rational SiteCheck - Rational robot	Rational SiteCheck (Windows NT)
1849	Unknown spider from Raytheon Company - maybe Raytheon High Speed Guard proxy	RAYSPIDER/Nutch-0.9
1850	Read A Blog - RSS feed and blog search engine	ReadABlog Spider (compatible; 1.1; feed update; www.readablog.com)
1851	RealDownload download manager	RealDownload/4.0.0.4x
1852	The REAP Web Crawler for the REAP project	REAP-crawler Nutch/Nutch-1.0-dev (Reap Project; http://reap.cs.cmu.edu/REAP-crawler/; Reap Project)
1853	Reaper robot for SiteSearch	Reaper [2.03.10-031204] (http://www.sitesearch.ca/reaper/)
1854	Reaper robot for SiteSearch	Reaper/2.0x (+http://www.sitesearch.ca/reaper)
1855	REBOL messaging language for distributed Internet apps	REBOL Core 2.x.x.x.x
1856	REBOL/View - machine independent internet client application	REBOL View 1.x.x.x.x
1857	Rebusnet software site - link / submission checking	RebusnetBot (+http://www.rebusnet.biz)
1858	Rebusnet software site - link / submission checking	RebusnetPADBot/1.5x (+http://www.rebusnet.biz)
1859	Online reciprocal link checker	reciprocal links checker (http://www.recip-links.com/)
1860	rediff.com search link checking	RedBot/redbot-1.0 (Rediff.com Crawler; redbot at rediff dot com)
1861	RedCarpet crawler for Pronto price comparison search(66.179.107.1xx)	RedCarpet/1.2 (http://www.redcarpet-inc.com/robots.html)
1862	Der Bot for telegenetic.net's security related search (65.220.67.2xx)	RedCell/0.1 (InfoSec Search Bot (Coming Soon); http://www.telegenetic.net/bot.html; lhall@telegenetic.net)
1863	Der Bot for telegenetic.net's security related search (65.220.67.2xx)	RedCell/0.1 (RedCell; telegenetic.net/bot.html; lhall_at_telegenetic.net)
1864	RedKernel Softwares robot	RedKernel WWW-Spider 2/0 (+http://www-spider.redkernel-softwares.com/)
1865	REL Link Checker Lite free version of Web Link Validator	REL Link Checker Lite x.x
1866	unknown	RepoMonkey Bait & Tackle/v1.01
1867	Rewebber proxy service	Rewebber/1.2 libwww-perl/5.41
1868	Applied Semantics Auto-Categorizer for QWestDex Direct	rico/0.1
1869	RixBot Rebol Indexer for the RIX - Rebol related search (195.204.121.xx)	RixBot (http://babelserver.org/rix)
1870	StreamBox VCR user agent	RMA/1.0 (compatible; RealMedia)
1871	Real Media server acting as client	RMA/1.0 (compatible; RealMedia)
1872	Canadian Content search crawler	RoboCrawl (http://www.canadiancontent.net)
1873	Canadian Content Search (207.44.220.xx) robot	RoboCrawl (www.canadiancontent.net)
1874	FindPal Australia metasearch robot (61.68.139.xx)	RoboPal (http://www.findpal.com/)
1875	PopJapanSearch robot	Robot/www.pj-search.com
1876	Experimental robot using Wget via attbi.net	Robot: NutchCrawler- Owner: wdavies@acm.org
1877	Supersnooper robot	Robot@SuperSnooper.Com
1878	Netscape Directory / DMOZ Open Directory link crawler	Robozilla/1.0
1879	ROME - Open source Java tools for RSS and Atom feeds	Rome Client (http://tinyurl.com/64t5n) Ver: 0.9
1880	Qualigo.de robot	Rotondo/3.1 libwww/5.3.1
1881	different IPs using the HTTPClient library (mostly link checking)	RPT-HTTPClient/0.3-x
1882	Metacarta.com (66.28.xx.xxx) robot	RRC (crawler_admin@bigfoot.com)
1883	RSS Bandit RSS/Atom reader for .NET framework	RssBandit/1.5.0.10 (.NET CLR 1.1.4322.2407; WinNT 5.1.2600.0; http://www.rssbandit.org) (.NET CLR 1.1.4322.2407; WinNT 5.1.2600.0; )
1884	RSS Micro Search - RSS feed search engine	RSSMicro.com RSS/Atom Feed Robot
1885	RSSOwl embedded RSS feed reader	RSSOwl/1.2.3 2006-11-26 (Windows; U; zhtw)
1886	RSSOwl embedded RSS feed reader	RSSOwl/1.2.4 Preview Release 2007-04-15 (Windows; U; zhtw)
1887	Ykoon RssReader news feed reader	RssReader/1.0.xx.x (http://www.rssreader.com) Microsoft Windows NT 5.1.2600.0
1888	Some site scanning tool via diff. IPs- i.e.: - dslx.net (208.35.1x.xxx) - Home.com	RSurf15a 41
1889	Some site scanning tool via diff. IPs- i.e.: - dslx.net (208.35.1x.xxx) - Home.com	RSurf15a 51
1890	Some site scanning tool via diff. IPs- i.e.: - dslx.net (208.35.1x.xxx) - Home.com	RSurf15a 81
1891	rubhub blog spider	Rubbot/1.0 (+http://rubhub.com/)
1892	WebarooBot - Webaroo web site search / theme based downloading tool (64.124.122.2xx)	RufusBot (Rufus Web Miner; http://64.124.122.252/feedback.html)
1893	WebarooBot - Webaroo web site search / theme based downloading tool (64.124.122.2xx)	RufusBot (Rufus Web Miner; http://www.webaroo.com/rooSiteOwners.html)
1894	unknown robot from rumours.jp (202.214.69.xxx)	Rumours-Agent
1895	RX (Reflexive Search) Bar for IE	RX Bar
1896	Search & Links directory spider	S&L Spider (http://search.hirners.com/)
1897	SEO-Tools.net link checking ?	S.T.A.L.K.E.R. (http://www.seo-tools.net/en/bot.aspx)
1898	SafariBookmarkChecker for Mac OS X	SafariBookmarkChecker (+http://www.coriolis.ch/)
1899	sait robot - unknown robot from Samsung International Korea	sait/Nutch-0.9 (SAIT Research; http://www.samsung.com)
1900	Sandcrawler robot from Microsoft (131.107.0.xx)	SandCrawler - Compatibility Testing
1901	Sapphire Web Crawler from Carnegie Mellon University's Language Technologies Institute	SapphireWebCrawler/1.0 (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)
1902	Sapphire Web Crawler from Carnegie Mellon University's Language Technologies Institute	SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)
1903	WebSavvy Directory robot	savvybot/0.2
1904	SiteSell SBIder Nutch based crawler	SBIder/0.7 (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)
1905	SiteSell SBIder Nutch based crawler	SBIder/0.8-dev (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)
1906	Softbyte Labs Black Widow web site ripper	SBL-BOT (http://sbl.net)
1907	ScanWeb - regular expression based web page searching tool	ScanWeb
1908	ScholarUniverse - Scholarly experts search robot	ScholarUniverse/0.8 (Nutch;+http://scholaruniverse.com/bot.jsp; fetch-agent@scholaruniverse.com)
1909	URL Spider Pro (USP) used by German Schwarzmann GmbH	schwarzmann.biz-Spider_for_paddel.org+(http://www.innerprise.net/usp-spider.asp)
1910	1X Web Browser	Science Traveller International 1X/1.0
1911	WebWobot UK search engine robot (82.43.129.2xx)	ScollSpider/2.0 (+http://www.webwobot.com/ScollSpider.php)
1912	Altavista robot	Scooter-3.0.EU
1913	Altavista robot	Scooter-3.0.FS
1914	Altavista robot	Scooter-3.0.HD
1915	Altavista robot	Scooter-3.0.VNS
1916	Altavista robot	Scooter-3.0QI
1917	Altavista robot	Scooter-3.2
1918	Altavista robot	Scooter-3.2.BT
1919	Altavista robot	Scooter-3.2.DIL
1920	Altavista robot	Scooter-3.2.EX
1921	Altavista robot	Scooter-3.2.JT
1922	Altavista robot	Scooter-3.2.NIV
1923	Altavista robot	Scooter-3.2.SF0
1924	Altavista robot	Scooter-3.2.snippet
1925	Altavista robot	Scooter-3.3dev
1926	Altavista robot	Scooter-ARS-1.1
1927	Altavista robot	Scooter-ARS-1.1-ih
1928	Altavista robot	scooter-venus-3.0.vns
1929	Altavista robot	Scooter-W3-1.0
1930	Altavista robot	Scooter-W3.1.2
1931	Altavista robot	Scooter/1.0
1932	Altavista robot	Scooter/1.0 scooter@pa.dec.com
1933	Altavista robot	Scooter/1.1 (custom)
1934	Altavista robot	Scooter/2.0 G.R.A.B. V1.1.0
1935	Altavista robot	Scooter/2.0 G.R.A.B. X2.0
1936	Altavista robot	Scooter/3.3
1937	Altavista robot	Scooter/3.3.QA.pczukor
1938	Altavista robot	Scooter/3.3.vscooter
1939	Altavista robot	Scooter/3.3_SF
1940	Altavista using Mercator robot	Scooter2_Mercator_x-x.0
1941	Altavista robot	Scooter_bh0-3.0.3
1942	Altavista robot	Scooter_trk3-3.0.3
1943	Scope Navigator mobile browser (Japan)	Scope (Mars+)
1944	Some nec.com robot using Research Republic ScoutAbout Research Tool	ScoutAbout
1945	Ant.com search robot	ScoutAnt/0.1; +http://www.ant.com/what_is_ant.com/
1946	ScoutMaster information retrieval software	scoutmaster
1947	Scrub the web robot (66.93.156.xx)	Scrubby/2.x (http://www.scrubtheweb.com/)
1948	Scrub the web robot (66.93.156.xx)	Scrubby/3.0 (+http://www.scrubtheweb.com/help/technology.html)
1949	URL Search+ search software	Search+
1950	Xtreem Search Engine Studio - SE software	Search-Engine-Studio
1951	Search.ch robot	search.ch V1.4
1952	Search.ch robot	search.ch V1.4.2 (spiderman@search.ch; http://www.search.ch)
1953	Enterprise Search web indexing / site searching tool	Search/1.0 (http://www.innerprise.net/es-spider.asp)
1954	Unknown robot / website grabber from Chinatelecom (219.142.78.xxx)	searchbot admin@google.com
1955	SearchByUSA robot (69.150.7.xxx)	SearchByUsa/2 (SearchByUsa; http://www.SearchByUsa.com/bot.html; info@SearchByUsa.com)
1956	Searchday (Germany) search robot	SearchdayBot
1957	Searchexpress spider	SearchExpress Spider0.99
1958	Searchguild forum & directory robot (81.3.75.xxx)	SearchGuild/DMOZ/Experiment (searchguild@gmail.com)
1959	Searchguild forum & directory robot (81.3.75.xxx)	SearchGuild_DMOZ_Experiment (chris@searchguild.com)
1960	Searchit robot (69.93.107.xx)	Searchit-Now Robot/2.2 (+http://www.searchit-now.co.uk)
1961	Searchmee! Search Engine (prototype) robot by findanisp.com	Searchmee! Spider v0.98a
1962	SearchSight search robot	SearchSight/2.0 (http://SearchSight.com/)
1963	SearchSpider robot	SearchSpider.com/1.1
1964	SearchSpider robot	Searchspider/1.2 (SearchSpider; http://www.searchspider.com; webmaster@searchspider.com)
1965	Janas (Ideare.com / Tiscali.it) robot	SearchTone2.0 - IDEARE
1966	seekport. beta search (Germany) robot	Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/0.3
1967	seekport. beta search (Germany) robot	Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.0 (XDF)
1968	seekport. beta search (Germany) robot	Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.2
1969	Lookseek search robot / link checking	Seeker.lookseek.com
1970	semaforo.net web filtering software	semaforo.net
1971	Semager.de (was NG-Search) semantic search - Germany	Semager/1.1 (http://www.semager.de/blog/semager-bots/)
1972	Semager.de (was NG-Search) semantic search - Germany	Semager/1.x (http://www.semager.de)
1973	Semantic Discovery domain checking tool	semanticdiscovery/0.x
1974	Sensis Australia search robot	Sensis Web Crawler (search_comments\at\sensis\dot\com\dot\au)
1975	Sensis Australia search robot	Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au)
1976	Seznam Search (Czech Republic) robot	SeznamBot/1.0
1977	Seznam Search (Czech Republic) robot	SeznamBot/1.0 (+http://fulltext.seznam.cz/)
1978	Seznam Search (Czech Republic) robot	SeznamBot/2.0-test (+http://fulltext.sblog.cz/)
1979	Unknown robot from Shablast.com - Website has no content - Ignores robots.txt	ShablastBot 1.0
1980	Shareaza P2P peer-to-peer download client	Shareaza v1.x.x.xx
1981	SharewarePlaza File Check Bot - link checking	SharewarePlazaFileCheckBot/1.0+(+http://www.SharewarePlaza.com)
1982	Chikayama-Taura Lab Shim-Crawler used for The Kototoi Project (Japan) - (133.11.36.xx)	Shim Crawler
1983	Chikayama-Taura Lab Shim-Crawler used for The Kototoi Project (Japan) - (133.11.36.xx)	Shim-Crawler(Mozilla-compatible; http://www.logos.ic.i.u-tokyo.ac.jp/crawler/; crawl@logos.ic.i.u-tokyo.ac.jp)
1984	ShopWiki shopping search based on LittleWiki search	ShopWiki/1.0 ( +http://www.shopwiki.com/)
1985	ShopWiki shopping search based on LittleWiki search	ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)
1986	Shoula Search Engine crawler	Shoula.com Crawler 2.0
1987	Siets Crawler - Web based site crawling application	SietsCrawler/1.1 (+http://www.siets.biz)
1988	Sigram's Nutch robot - crawler testing	Sigram/Nutch-1.0-dev (Test agent for Nutch development; http://www.sigram.com/bot.html; bot at sigram dot com)
1989	Siigle search (Turkey) robot	Siigle Orumcex v.001 Turkey (http://www.siigle.com)
1990	Slider Search directory robot (194.213.194.2xx)	silk/1.0
1991	Slider Search directory robot (194.213.194.2xx)	silk/1.0 (+http://www.slider.com/silk.htm)/3.7
1992	SimpleFavPanel - IE newsfeed panel plugin	SimpleFavPanel/1.2
1993	Simpy bookmarking and personal search engine	Simpy 1.x; http://www.simpy.com/
1994	Simpy bookmarking and personal search engine	Simpy/1.x (Simpy; http://www.simpy.com/?ref=bot; feedback at simpy dot com)
1995	Sirketçe search - Turkey	Sirketcebot/v.01 (http://www.sirketce.com/bot.html)
1996	SiteBar online bookmark manager	SiteBar/3.x.x (Bookmark Server; http://sitebar.org/)
1997	SiteBar bookmark server	SiteBar/x.x
1998	SiteBar bookmark server	SiteBar/x.x.x (Bookmark Server; http://sitebar.org/)
1999	Internetseer Web Site Monitoring / Claymont robot	sitecheck.internetseer.com
2000	Internetseer Web Site Monitoring	sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
2001	SiteRecon website monitoring spider at xx minute intervals	SiteRecon+(xx)
2002	PC Magazin web site downloadmanager	SiteSnagger
2003	Site Spider robot (66.249.17.xx)	SiteSpider +(http://www.SiteSpider.com/)
2004	SiteSucker Mac website downloading tool	SiteSucker/1.x.x
2005	SiteTagger.com bookmark organizer	SiteTaggerBot (http://www.sitetagger.com/bot.htm)
2006	SiteTruth - Automatic site legitimacy rating system	SiteTruth.com site rating system
2007	Webwasher.com (217.146.159.xx) internet filter	SiteWinder
2008	Xtreeme SiteXpert sitemap & search engine builder	SiteXpert
2009	Skaffe.com directory link checker	Skampy/0.9.x (http://www.skaffe.com/skampy-info.html)
2010	Skaffe.com directory link checker	Skimpy/0.x (http://www.skaffe.com/skampy-info.html)
2011	Visvo distributed website crawler based on Nutch	Skywalker/0.1 (Skywalker; anonymous; anonymous)
2012	Only.com robot	Slarp/0.1
2013	Sleipnir - Japanese Explorer based browser & search bar	Sleipnir
2014	Sleipnir - Japanese Explorer based browser & search bar	Sleipnir Version 1.xx
2015	Sleipnir - Japanese Explorer based browser & search bar	Sleipnir Version2.x
2016	Sleipnir - Japanese Explorer based browser & search bar	Sleipnir/2.xx
2017	Slider Search directory robot (194.213.194.2xx)	Slider_Search_v1-de
2018	Slim Browser (IE based browser) - uses this user agent for favicon.ico only	SlimBrowser
2019	Inktomi (Hotbot-Lycos-NBCi) robot	Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
2020	Inktomi (Hotbot-Lycos-NBCi) robot	Slurp/2.0-KiteWeekly (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
2021	Inktomi (Hotbot-Lycos-NBCi) robot	Slurp/si (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
2022	Inktomi (Hotbot-Lycos-NBCi) robot - 72.30.61.xx(x)	Slurpy Verifier/1.0
2023	Slysearch robot (now Turnitin robot)	SlySearch (slysearch@slysearch.com)
2024	Slysearch robot (now Turnitin robot)	SlySearch/1.0 http://www.plagiarism.org/crawler/robotinfo.html
2025	Slysearch robot (now Turnitin robot)	SlySearch/1.x http://www.slysearch.com
2026	Netzip/Smartdownload download manager	SmartDownload/1.2.67 (Win32; Jan 12 1999)
2027	Netzip/Smartdownload download manager	SmartDownload/1.2.77 (Win32; Feb 1 2000)
2028	Netzip/Smartdownload download manager	SmartDownload/1.2.77 (Win32; Jun 19 2001)
2029	Loop Improvements NRS Enterprise search (69.44.155.xx[x])	smartwit.com
2030	SmiffyDCMetaSpider - Robot to check the retro-adding of Dublin Core metadata	SmiffyDCMetaSpider/1.0
2031	Snoopy PHP-client	sna-0.0.1 (mikemuzio@msn.com)
2032	Snoopy PHP-client	sna-0.0.1 mikeelliott@hotmail.com
2033	Unknown bot from bb2.net (66.234.139.xxx) also as Snapbot/1.0	snap.com beta crawler v0
2034	Unknown bot from bb2.net (66.234.139.xxx) - also as snap.com	Snapbot/1.0
2035	Unknown bot from Psinet / Cogentco - not from Snap.com	Snapbot/1.0 (Snap Shots, +http://www.snap.com)
2036	My UrlTrends online web ranking service	Snappy/1.1 ( http://www.urltrends.com/ )
2037	Snarfer RSS reader	Snarfer/0.x.x (http://www.snarfware.com/)
2038	Unknown robot from 217.229.156.xx (T-Online Germany)	SnoopRob/x.x
2039	Snoopy PHP-client	Snoopy v1.xx
2040	Snoopy PHP-client	Snoopy v1.xx- : User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MyIE2)
2041	Snoopy PHP-client	Snoopy_v0.xx
2042	Snyke.com France robot	SnykeBot/0.6 (http://www.snyke.com)
2043	Link crawler for the social sciences	SocSciBot ()
2044	NetFront browser on Softbank mobile phone	SoftBank/1.0/812SH/SHJ001 Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1
2045	Soft Hypermarket link checking	SoftHypermarketFileCheckBot/1.0+(+http://www.softhypermaket.com)
2046	Softizer.com software directory link checking	Softizerbot (http://www.softizer.com)
2047	Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot	sogou develop spider
2048	Unknown UA from Chinanet (220.181.18.xx) faking Sogou search robot	Sogou Orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
2049	Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot	sogou spider
2050	Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot	Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
2051	Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot	sohu agent
2052	Sohu (Search Fox) search robot China (61.135.131.xxx)	sohu-search
2053	SOSO search (China) spider	Sosospider+(+http://help.soso.com/webspider.htm)
2054	Default Proxomitron (discontinued) filtering proxy user agent identifier	Space Bison/0.02 [fu] (Win67; X; SK)
2055	Speed Download (Mac) download manager	SpeedDownload/1.x
2056	Speedfind.de robot	speedfind ramBot xtreme 8.1
2057	Entireweb search robot	Speedy Spider (Beta/x.x; speedy@entireweb.com)
2058	Entireweb search spider	Speedy Spider (Entireweb; Beta/1.0; http://www.entireweb.com/about/search_tech/speedyspider/)
2059	Entireweb search robot	Speedy_Spider (http://www.entireweb.com)
2060	Sphere blog and news search robot	Sphere Scout&v4.0 - scout at sphere dot com
2061	Sphider - a lightweight search engine in PHP	Sphider
2062	Only.com robot	Spida/0.1
2063	Search-Info ODP/DMOZ spider	Spider-Sleek/2.0 (+http://search-info.com/linktous.html)
2064	Batsch robot	spider.batsch.com
2065	TerraNautic spider for Schnellsuchen touristic search (Germany)	Spider.TerraNautic.net - v:1.04
2066	Yellopet spider	spider.yellopet.com - www.yellopet.com
2067	Maxbot .gov .mil .edu indexing robot	Spider/maxbot.com admin@maxbot.com
2068	Unknown robot from CPE at Kasetsart University (158.108.35.xxx)	SpiderKU/0.x
2069	Yahoo Search user agent or spider (202.165.102.xxx)	SpiderMan
2070	SpiderMonkey Canada robot	SpiderMonkey/7.0x (SpiderMonkey.ca info at http://spidermonkey.ca/sm.shtml)
2071	Spider.de robot	Spinne/2.0
2072	Medkatalog (medical catalogue) Austria robot	Spinne/2.0 med
2073	Medkatalog (medical catalogue) Austria robot	Spinne/2.0 med_AH
2074	Spock - people search application - via Amazon web services	Spock Crawler (http://www.spock.com/crawler)
2075	Sportsuchmaschine (German sports related search) link checking / robot	sportsuchmaschine.de-Robot (Version: 1.02- powered by www.sportsuchmaschine.de)
2076	Sproose personalized search (38.100.225.xx)	sproose/0.1-alpha (sproose crawler; http://www.sproose.com/bot.html; crawler@sproose.com)
2077	SQ Webscanner Mac download manager	SQ Webscanner
2078	Simple page-prefetch for Squid web proxy	Squid-Prefetch
2079	Squidclam is a replacement for SquidClamAV-Redirector	squidclam
2080	SCAVR - Squid helper script for scanning download URLs for viruses	SquidClamAV_Redirector 1.x.x
2081	AOL Search / Pacific Internet Exchange robot	Sqworm/2.9.81-BETA (beta_release; 20011102-760; i686-pc-linux-gnu)
2082	diff. IPs / services i.e.: - Inria.fr robot - Websense (Internet filtering) robot	Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux-gnu)
2083	Time Warner Telecom user robot ?	Sqworm/2.9.89-BETA (beta_release; 20020130-839; i686-pc-linux-gnu)
2084	Some site scanning tool via diff. IPs i.e.: - choiceone.net (216.153.xxx.xxx) - epix.net (216.108.198.xx)	SSurf15a 11
2085	Rambler search (Russia) robot (81.19.6x.xx)	StackRambler/x.x
2086	Stamina download manager	Stamina/1.4
2087	Star Downloader download manager	Star Downloader
2088	Star Downloader download manager	StarDownloader/1.xx
2089	Experimental search engine spider from 66.92.186.xxx	stat statcrawler@gmail.com
2090	Steeler crawler	Steeler/1.x (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
2091	Steeler - University of Tokyo web crawler	Steeler/3.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
2092	Strategic Board blog & news search robot	Strategic Board Bot (+http://www.strategicboard.com)
2093	Strategic Board blogs and news aggregator robot	Strategic Board Bot (+http://www.strategicboard.com)
2094	Surfsafely submission verifier	Submission Spider at surfsafely.com
2095	Suchbaer.de (Germany) search robot	suchbaer.de
2096	Suchbaer.de (Germany) search robot	suchbaer.de (CrawlerAgent v0.103)
2097	Suchbot Germany robot	suchbot
2098	Suchknecht Austria robot	Suchknecht.at-Robot
2099	suchpad search Germany robot (213.239.194.xx)	suchpadbot/1.0 (+http://www.suchpad.de)
2100	Sunrise XP handheld news / website reader and converter	Sunrise XP/2.x
2101	Sunrise XP web sites and newsfeeds converter and handheld reader	Sunrise/0.42g (Windows XP)
2102	SuperBot website copier	SuperBot/x.x (Win32)
2103	SuperBot website copier	SuperBot/x.x.x.xx (Windows XP)
2104	Ubbi Superdownloads (Brazil) link checking	Superdownloads Spiderman
2105	SurfControl Web Filtering	SURF
2106	Wanadoo Rechereche robot	SurferF3 1/0
2107	Maskbit Surfmaster bookmark tool	SurfMaster
2108	Whois Source domain name information robot (66.249.26.xx)	SurveyBot/2.2 <a href='http://www.whois.sc'>Whois Source</a>
2109	Whois Source domain name information robot (66.249.26.xx)	SurveyBot/2.3 (Whois Source)
2110	Yokogao Search Engine robot (Kanazawa University)	suzuran
2111	HP Secure Web Browser for OpenVMS	SWB/V1.4 (HP)
2112	unknown	swbot/0.9c libwww/5.3.1
2113	Swooglebot Swoogle's semantic web crawler	Swooglebot/2.0. (+http://swoogle.umbc.edu/swooglebot.htm)
2114	SWSBot - SmartWareSoft (85.186.255.xx) software search engine created for Playfuls.com	SWSBot-Images/1.2 http://www.smartwaresoft.com/swsbot12.html
2115	Sygol Search (Italy) robot	SygolBot http://www.sygol.net
2116	Sylera browser (Japan)	Sylera/1.2.x
2117	Mindspring.com user robot	SyncBot
2118	SyncIT link validation	SyncIT/x.x
2119	Syndirella desktop information aggregator (beta)	Syndirella/0.91pre
2120	Synomia (France) robot	SynoBot
2121	Syntryx Solution Suite - domain / keyword crawler (216.7.179.xx)	Syntryx ANT Scout Chassis Pheromone; Mozilla/4.0 compatible crawler
2122	Szukacz.pl (Polish search) robot	Szukacz/1.x
2123	Szukacz.pl (Polish search) robot	Szukacz/1.x (robot; www.szukacz.pl/jakdzialarobot.html; szukacz@proszynski.pl)
2124	German T-Online browser & internet suite	T-Online Browser
2125	tags2dir.com directory index	tags2dir.com/0.8 (+http://tags2dir.com/directory/)
2126	TAGword DMOZ survey - ODP link checking robot	Tagword (http://tagword.com/dmoz_survey.php)
2127	Tagyu - del.icio.us bookmark collection online tag generator	Tagyu Agent/1.0
2128	Daumsoft Talkro IR robot	Talkro Web-Shot/1.0 (E-mail: webshot@daumsoft.com- Home: http://222.122.15.190/webshot)
2129	Texas A&M University - Dept. of Computer Science crawler (server or link checking ?)	TAMU_CS_IRL_CRAWLER/1.0
2130	Targetblaster user link validation ?	targetblaster.com/0.9k
2131	Target Your News - user submitted links	TargetYourNews.com bot
2132	Trinity College Dublin (Ireland) TCDBOT	TCDBOT/Nutch-0.8 (PhD student research;http://www.tcd.ie; mcgettrs at t c d dot IE)
2133	HTTP header for transfer encoding used as user agent name ?	TE
2134	WinInet Internet client app.	TeamSoft WinInet Component
2135	Tecomac Gmbh (Germany) crawler software - now Arexera Information Technologies	TECOMAC-Crawler/0.x
2136	Tecomi (Germany) beta / test robot (84.201.65.xxx)	Tecomi Bot (http://www.tecomi.com/bot.htm)
2137	Teemer crawler for NetSeer search (beta) via Amazon Web Services - see also NetSeer/Nutch	Teemer (NetSeer, Inc. is a Los Angeles based Internet startup company.; http://www.netseer.com/crawler.html; crawler@netseer.com)
2138	Teleport (website) downloading tool	Teleport Pro/1.2x(.1xxx)
2139	Teoma crawler (65.214.36.xx[x])	Teoma MP
2140	Teoma crawler (65.214.36.xx[x])	teomaagent crawler-admin@teoma.com
2141	Teoma crawler (65.214.36.xx[x])	teomaagent1 [crawler-admin@teoma.com]
2142	Teoma crawler (65.214.36.xx[x])	teoma_agent1
2143	Teradex Directory robot	Teradex Mapper; mapper@teradex.com; http://www.teradex.com
2144	Teragram multilingual text & data processing software	TeragramCrawler
2145	Terraminds blog search (Germany)	terraminds-bot/1.0 (support@terraminds.de)
2146	Terrawiz Indian Search Engine robot	TerrawizBot/1.0 (+http://www.terrawiz.com/bot.html)
2147	Noceans Information Portfolio Manager (66.35.69.x)	Test spider
2148	Balihoo - Search Engine for Advertising Media	TestCrawler/Nutch-0.9 (Testing Crawler for Research ; http://balihoo.com/index.aspx; tgautier at balihoo dot com)
2149	Expert HTML online source viewer	The Expert HTML Source Viewer (http://www.expert-html.com)
2150	The Rarest Words - Linguistic experiment crawler via Amazon Web Services	TheRarestParser/0.2a (http://therarestwords.com/)
2151	TheSuBot robot (Germany) for an unknown theme based search engine	TheSuBot/0.1 (www.thesubot.de)
2152	ThumbShots website thumbnail service (Germany) robot	thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de)
2153	ThumbShots.de (Germany) robot	thumbshots-de-Bot (Version: 1.02- powered by www.thumbshots.de)
2154	Breaking Blogs timbo bot blog robot	timboBot/0.9 http://www.breakingblogs.com/timbo_bot.html
2155	TimelyWeb web page monitoring tool	http://www.timelyweb.com/
2156	TinEye crawler for an open image search project	TinEye/1.1 (http://tineye.com/crawler.html)
2157	Tivra spider from AT&T Labs Research	tivraSpider/1.0 (crawler@tivra.com)
2158	Tjgroup spider	TJG/Spider
2159	TJvHttpGrabber (JEDI Visual Component Library)	TJvMultiHttpGrabber Component
2160	Tkensaku Search (Japan) robot from 210.239.46.xxx (www.tken.com)	Tkensaku/x.x(http://www.tkensaku.com/q.html)
2161	Unknown robot from 195.68.98.xx (coltfrance.com)	toCrawl/UrlDispatcher
2162	Topodia search engine and personal information assistant (in development)	Topodia/1.2-dev (Topodia - Crawler for HTTP content indexing; http://www.topodia.com/; support@topodia.com)
2163	Topos search (Russia) robot	TOPOS robot/1.1 (http://www.topos.com.ua/)
2164	Traazi! search (Germany) robot	traazibot/testengine (+http://www.traazi.de)
2165	Trailfire web collection and annotating system	Trailfire-bot/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)
2166	Trailfire web collection and annotating system	Trailfire-bot/0.7.1 (Trailfire page content analyzer; http://trailfire.com; info@trailfire.com)
2167	Trailfire web collection and annotating system	Trailfire/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)
2168	Trampelpfad Webkatalog spider	Trampelpfad-Spider
2169	Trampelpfad Webkatalog spider	Trampelpfad-Spider-v0.1
2170	Tricos meta tag validation	tricosMetaCheck 1.2216-08-1999 (http://www.tricos.com/metacheck)
2171	some bad user agent	TSurf15a 11
2172	Tulip Chain browser / link checker for Dmoz.org directory	TulipChain/5.x (http://ostermiller.org/tulipchain/) Java/1.x.1_0x (http://java.sun.com/) Linux/2.4.17
2173	Tulip Chain browser / link checker for Dmoz.org directory	TulipChain/5.xx (http://ostermiller.org/tulipchain/) Java/1.x.1_0x (http://apple.com/) Mac_OS_X/10.2.8
2174	Tumblr Tumblelogs RSS and news syndication crawler	Tumblr/1.0 RSS syndication (+http://www.tumblr.com/) (support@tumblr.com)
2175	Turnitin (ex SlySearch) robot for helping educational institutions prevent plagiarism	TurnitinBot/x.x (http://www.turnitin.com/robot/crawlerinfo.html)
2176	TurnPike Emporium Directory (207.67.198.x) link checking	Turnpike Emporium LinkChecker/0.1
2177	TutorGig tutorial search robot	TutorGig/1.5 (+http://www.tutorgig.com/crawler)
2178	TutorGig tutorial search robot	Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler)
2179	Twiceler experimental web crawler	Twiceler www.cuill.com/robots.html
2180	Twiceler experimental web crawler	Twiceler-0.9 http://www.cuill.com/twiceler/robot.html
2181	File downloading component from Twisted Python	Twisted PageGetter
2182	Twitt(url)y URL tracking service for Twitter via Amazon Web Services	Twitturly / v0.x
2183	Twotrees content filter	Twotrees Reactive Filter V2.0
2184	Tycoon - Hewlett-Packards distributed cluster solution robot	Tycoon Agent/Nutch-1.0-dev
2185	Tygo Search robot	TygoBot
2186	Tygo Search robot	TygoProwler
2187	UCMore - IE navigation and search plugin	UCmore
2188	UCMore - IE navigation and search plugin	UCMore Crawler App
2189	Ucweb mobile browser	UCWEB5.1
2190	user agent - maybe UdmSearch (see UdmSearch) ?	UDM
2191	UdmSearch / MySearch (now mnoGoSeach) offline browser/search client	UdmSearch/3.1.x
2192	University of Iowa Crawler- possibly MySpiders	UIowaCrawler/1.0
2193	UKWizz search robot	UKWizz/Nutch-0.8.1 (UKWizz Nutch crawler; http://www.ukwizz.com/)
2194	Infoseek robot	Ultraseek
2195	Unknown mail harvester/spambot from 80.58.13.xxx (proxycache.rima-tde.net)	Under the Rainbow 2.2
2196	DNS Right - Online DNS tools	unknownght.com Web Server IIS vs Apache Survey. See Results at www.DNSRight.com
2197	Unknown robot from University of Toronto (128.100.5.1xx)	UofTDB_experiment (leehyun@cs.toronto.edu)
2198	Mobile phone browser	UP.Browser/3.01-IG01 UP.Link/3.2.3.4
2199	Updated! search robot	updated/0.1-alpha (updated crawler; http://www.updated.com; crawler@updated.com)
2200	Updated! search robot	updated/0.1beta (updated.com; http://www.updated.com; crawler@updated.om)
2201	Handspring (PalmOS powered cellphone) Treo Blazer browser	UPG1 UP/4.0 (compatible; Blazer 1.0)
2202	UptimeBot.com online link popularity check	Uptimebot
2203	UptimeBot.com online link popularity check	UptimeBot(www.uptimebot.com)
2204	URI::Fetch - client for fetching HTTP pages and syndication feeds (RSS Atom)	URI::Fetch/0.06
2205	Innerprise URL Spider Pro (now ES.NET) web indexing / site searching tool	URL Spider Pro/x.xx (innerprise.net)
2206	URLBase - Internet shortcut manager	URLBase/6.x
2207	URLBlaze file sharing link toolkit	URLBlaze
2208	://URLFAN news crawler	urlfan-bot/1.0; +http://www.urlfan.com/site/bot/350.html
2209	URLGetFile downloading tool	URLGetFile
2210	Innerprise URL Spider Pro (now ES.NET) web indexing / site searching tool	URL_Spider_Pro/x.x
2211	Innerprise URL Spider Pro (now ES.NET) web indexing / site searching tool	URL_Spider_Pro/x.x+(http://www.innerprise.net/usp-spider.asp)
2212	BoardReader search favicon fetcher	User-Agent: BoardReader Favicon Fetcher /1.0 info@boardreader.com
2213	BoardReader search image fetcher	User-Agent: BoardReader Image Fetcher /1.0 info@boardreader.com
2214	ljpic.com - LiveJournal picture feed search	User-Agent: LjSEEK Picture-Bot /1.0 contact@ljseek.com
2215	FileHeap download manager	User-Agent: FileHeap! file downloader (http://www.fileheap.com)
2216	Malformed UA header from some guestbook/forum spammer	User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
2217	Skizzle search robot	User-Agent: Mozilla/4.0 (SKIZZLE! Distributed Internet Spider v1.0 - www.SKIZZLE.com)
2218	unknown robot (reads robots.txt) or sitegrabber. From different IPs- ie.: 62.98.8.xx (wind.it)	user-agent=Mozilla/3.01Gold
2219	University of Sydney NLP Spider for research in Natural Language Processing	USyd-NLP-Spider (http://www.it.usyd.edu.au/~vinci/bot.html)
2220	Web Thief Site Grabber	UtilMind HTTPGet
2221	WebWasher ad filter	Utopia WebWasher 3.0
2222	uTorrent BitTorrent client	uTorrent/1500
2223	Unknown bad behaving bot via Road Runner - see link	VadixBot
2224	WiseGuys WAP pages robot	Vagabondo-WAP/2.0 (webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)/1.0 Profile
2225	WiseGuys robot Netherland - 82.94.216.2	Vagabondo/1.x MT (webagent@wise-guys.nl)
2226	WiseGuys robot Netherland - 82.94.216.2	Vagabondo/2.0 MT
2227	WiseGuys robot Netherland - 82.94.216.2	Vagabondo/2.0 MT (webagent at wise-guys dot nl)
2228	WiseGuys robot Netherland - 82.94.216.2	Vagabondo/2.0 MT (webagent@NOSPAMwise-guys.nl)
2229	WiseGuys robot Netherland - 82.94.216.2	Vagabondo/3.0 (webagent at wise-guys dot nl)
2230	Open Directory link checking from Vakes	Vakes/0.01 (Vakes; http://www.vakes.com/; search@vakes.com)
2231	unknown level3.net (63.214.172.xxx) robot	VayalaCreep-v0.0.1 (haploid@haploid.com)
2232	unknown level3.net (63.214.172.xxx) robot	Vayala|Creep-v0.0.1 (codepoet@wildties.com)
2233	iNet Grabber - Internet content grabber	vb wininet
2234	Versus Project robot - Comparing methods for near-uniform URL sampling	versus 0.2 (+http://versus.integis.ch)
2235	Unknown robot from EPFL University Switzerland (128.178.155.xxx)	versus crawler eda.baykan@epfl.ch
2236	Verticrawl - Semantic search engine solution (French)	Verticrawlbot
2237	VeryGoodSearch.com link submission checking	VeryGoodSearch.com.DaddyLongLegs
2238	Verzamelgids NL link checking robot	verzamelgids.nl - Networking4all Bot/x.x
2239	Verzamelgids NL link checking robot	Verzamelgids/2.2 (http://www.verzamelgids.nl)
2240	Unknown robot from Yahoo Norway	Vespa Crawler
2241	Sidewinder G2 anti-virus and anti-spyware protection	virus_detector (virus_harvester@securecomputing.com)
2242	Visbot crawler for a search software under development	VisBot/2.0 (Visvo.com Crawler; http://www.visvo.com/bot.html; bot@visvo.com)
2243	Some IE toolbar made with Visicom Media Dynamic Toolbar software	Visicom Toolbar
2244	Vision research lab's Cortina - content based image retrieval (128.111.60.xx)	Vision Research Lab image spider at vision.ece.ucsb.edu
2245	VLC - Cross-platform media player and streaming server	VLC media player - version 0.8.5 Janus - (c) 1996-2006 the VideoLAN team
2246	VM - Vertical Search Engine (China)	VMBot/0.x.x (VMBot; http://www.VerticalMatch.com/; vmbot@tradedot.com)
2247	Vortex Web Indexing Robot for a study on internet link distribution	Vortex/2.2 (+http://marty.anstey.ca/robots/vortex/)
2248	Kosmix health, auto and travel search crawler (204.14.48.x / 38.113.234.xxx)	voyager-hc/1.0
2249	Kosmix health, auto and travel search crawler (204.14.48.x / 38.113.234.xxx)	voyager/1.0
2250	Kosmix health, auto and travel search crawler (204.14.48.x / 38.113.234.xxx)	voyager/2.0 (http://www.kosmix.com/html/crawler.html)
2251	Vivisimo search crawler (206.210.89.xxx)	VSE/1.0 (testcrawler@hotmail.com)
2252	Vivisimo search crawler (206.210.89.xxx)	VSE/1.0 (testcrawler@vivisimo.com)
2253	Verity vspider indexing software	vspider
2254	Verity vspider indexing software	vspider/3.x
2255	VWBot - MetaQuerier Crawler for the MetaQuerier project at the University of Illinois	VWBOT/Nutch-0.9-dev (VWBOT Nutch Crawler; http://vwbot.cs.uiuc.edu;+vwbot@cs.uiuc.edu
2256	W3C Link Checker	W3C-checklink/3.x.x.x libwww-perl/5.xx
2257	W3C Link Checker	W3C-checklink/4.x [4.xx] libwww-perl/5.xxx
2258	WebCon - the Libwww command line tool	W3C-WebCon/5.x.x libwww/5.x.x
2259	W3C Line Mode (character based Web browser)	W3CLineMode/5.4.0 libwww/5.x.x
2260	Unknown link checking using Libwww via Korea Telecom (221.148.44.xxx)	W3CRobot/5.4.0 libwww/5.4.0
2261	W3C HTML-Code Validator	W3C_Validator/1.xxx libwww-perl/5.xx
2262	w3m Linux pager / text-based browser	w3m/0.x.xx
2263	W3 Site Search (Germany) search engine solution	W3SiteSearch Crawler_v1.1 http://www.w3sitesearch.de
2264	Wadain (Japan) Blog / RSS search crawler	wadaino.jp-crawler 0.2 (http://wadaino.jp/)
2265	Wanna-Be text mode browser	WannaBe (Macintosh; PPC)
2266	WapOnWindows WAP browser for PCs	WapOnWindows 1.0
2267	Watchfire WebXM intranet solution	Watchfire WebXM 1.0
2268	WAVcheck - Simple Vendor Discovery Tool for detecting client-side tags from web analytics vendors	WAVcheck 1.0.x (http://www.webbanalys.se/apps/WAVcheck/)
2269	Wavefire local search community engine (64.141.15.1xx)	Wavefire/0.8-dev (Wavefire; http://www.wavefire.com; info@wavefire.com)
2270	Waypath blog discovery engine robot	Waypath development crawler - info at waypath dot com
2271	Waypath blog discovery engine robot	Waypath Scout v2.x - info at waypath dot com
2272	WDG HTML-code validator	WDG_Validator/1.1
2273	Datafire.com's Web Image Collector (graphics downloading tool)	Web Image Collector
2274	Relsoft link checking software	Web Link Validator 1.5
2275	RankMeter ranking software	Web Snooper
2276	Web-bekannt German web directory link checking	web-bekannt (Version: 1.02, powered by www.internetservice-franken.de)
2277	Web-bekannt German web directory link checking	web-bekannt (Version: 1.02, powered by www.web-bekannt.de)
2278	Unkown link or server checking from Würzburg University Germany (132.187.10.xx)	Web-Bot V1.03
2279	Unknown robot from 69.50.233.x (nectartech.com)	Web-Robot/5.0 (en-US; web-robot.com/policy.html) Web-Robot Crawler/2.0.3
2280	Web2Express / Web2x - Open data searching tool	web2express.org/Nutch-0.9-dev (leveled playing field; http://web2express.org/; info at web2express.org)
2281	WebAlta search Russia crawler (85.21.201.xx)	WebAlta Crawler/1.2.1 (http://www.webalta.ru/bot.html)
2282	WebarooBot / RufusBot from webaroo offline search service	WebarooBot (Webaroo Bot; http://64.124.122.252/feedback.html)
2283	WebarooBot / RufusBot from webaroo offline search service	WebarooBot (Webaroo Bot; http://www.webaroo.com/rooSiteOwners.html)
2284	Yanasoft WebAuto website copier / downloading tool	WebAuto/3.4xxx (WinNT; I)
2285	Web Bandit personal search software	webbandit/4.xx.0
2286	Amansoft WebBug web server protocol test	WebBug/5.x
2287	WebClipping.com - online news monitoring service	Webclipping.com
2288	WebCollage Syndicator graphics crawler/collector	webcollage/1.xx
2289	Quarterdecks WebCompass search tool	WebCompass 2.0
2290	WebCopier offline browser	WebCopier vx.x
2291	WebCopier offline browser	WebCopier vx.xa
2292	WebCorp linguistic search engine (UK)	WebCorp/1.0
2293	Webcrawl Search robot (64.40.105.xxx)	webcrawl.net
2294	Unix/Linux Web Downloader	WebDownloader for X x.xx
2295	Unknown robot from china-netcom.com	Webdup/0.9
2296	WingFlyer WebFetch website downloading tool	WebFetch
2297	webfetch - command line tool to fetch files via HTTP	webfetch/5.x.x
2298	Verso NetSpective WebFilter	WebFilter Robot 1.0
2299	Telemate.net NetSpective WebFilter	WebFilter Robot 1.x
2300	Webfind search robot	WebFindBot(http://www.web-find.com)
2301	Webglimpse search engine software	Webglimpse 2.xx.x (http://webglimpse.net)
2302	webGobbler - Online random image generator	webGobbler/1.x.x
2303	fake ?	webhack
2304	herbert.groot.jebbink.nl Web Images collage generator	WebImages 0.3 ( http://herbert.groot.jebbink.nl/?app=WebImages )
2305	WebLight web analyzer & link checker	WebLight/4.x.x (support@illumit.com; http://www.illumit.com/Products/weblight/)
2306	WebLink's link management system for HTTP- FTP and Mail hyperlinks	Weblink's checker/
2307	Los Alamos National Laboratoy weblog research project	Weblog Attitude Diffusion 1.0
2308	Unknown robot from Leipzig University (Germany) faculty for computer science	webmeasurement-bot, http://rvs.informatik.uni-leipzig.de
2309	WebMiner bulk file downloader	WebMiner/x.x [en] (Win98; I)
2310	WeBoX (Japan) - Browser and web collector	WeBoX/0.xx
2311	WebPix - picture downloading tool	WebPix 1.0 (www.netwu.com)
2312	Caesius WebQL - Custom robot/agent generator / web extraction software	WebQL
2313	WebRACE - HTTP retrieval- annotation and caching engine	WebRACE/1.1 (University of Cyprus- Distributed Crawler)
2314	WebRankSpider experimental web crawler	WebRankSpider/1.37 (+http://ulm191.server4you.de/crawler/)
2315	Webreaper download manager	WebReaper vx.x - www.webreaper.net
2316	Webreaper download manager	WebReaper [info@webreaper.net]
2317	Webreaper download manager	WebReaper [webreaper@webreaper.net]
2318	Websearch Australia robot	WebSearch.COM.AU/3.0.1 (The Australian Search Engine; http://WebSearch.COM.AU; Search@WebSearch.COM.AU)
2319	Dortmund University WebSearchBench - Open source search software	WebSearchBench WebCrawler v0.1(Experimental)
2320	Dortmund University WebSearchBench - Open source search software	WebSearchBench WebCrawler V1.0 (Beta)- Prof. Dr.-Ing. Christoph Lindemann- Universität Dortmund- cl@cs.uni-dortmund.de- http://websearchbench.cs.uni-dortmund.de/
2321	Web site downloading tool and offline browser (Japan)	Website Explorer/0.9.x.x
2322	Website eXtractor web site downloading tool	Website eXtractor
2323	Sootle web directory Website Worth ranking tool	WebsiteWorth v1.0
2324	Webspinne.de robot	Webspinne/1.0 webmaster@webspinne.de
2325	Websquash.com Search Engine robot / link checking	Websquash.com (Add url robot)
2326	WebStat - Java statistical computing environment for the web	WebStat/1.0 (Unix; beta; 20040314)
2327	Webster - Rev. Healeys web crawler	Webster v0.3 ( http://webster.healeys.net/ )
2328	Websters Webmaster Archive (Germany) submission / pad checking	webster-internet.de pad browser
2329	WebStripper download manager	WebStripper/2.xx
2330	WebTrafficExpress IBM server software	WebTrafficExpress/x.0
2331	Web Trends link analyzer	WebTrends/3.0 (WinNT)
2332	The Stanford WebBase Project crawler	WebVac (webmaster@pita.stanford.edu)
2333	webval - Python link checking tool	WebVal/1.0
2334	Webverzeichnis.de (Germany) directory robot	Webverzeichnis.de - Telefon: 01908 / 26005
2335	Web Vulnerability Crawler	WebVulnCrawl.unknown/1.0 libwww-perl/5.803
2336	Studio Net.Idea's Web Watcher Monitor robot	WebWatcherMonitor/2.01
2337	WebZip offline browser	WebZIP/x.x (http://www.spidersoft.com)
2338	Unknown spam bot / harvester (62.163.**.** / 62.194.**.*)	Wells Search II
2339	Some spam bot- see link	WEP Search 00
2340	wwIPStuff - Internet client tools for Visual FoxPro	West Wind Internet Protocols 4.xx
2341	IBM's Almaden Research robot (Clever search project)	WFARC
2342	GNU wget - file downloader	Wget/1.x(.x)GNU wget http://www.gnu.org/software/wget/wget.html - file downloader
2343	GNU wget - file downloader	Wget/1.x+cvs-stable (Red Hat modified)
2344	GNU wget - file downloader	Wget/1.x.x+cvs
2345	Whatsup Gold network monitor	Whatsup/x.x
2346	WhatUSeek / Chubba robot	whatUseek_winona/3.0
2347	WhizBang! Labs (closed since May 2002) information extraction robot	WhizBang! Lab
2348	some download agent	Wildsoft Surfer
2349	Twotrees crawler	Willow Internet Crawler by Twotrees V2.1
2350	unknown robot from gw.ocg-corp.com (209.126.176.x)	WinampMPEG/2.00 (larbin@unspecified.mail)
2351	Super Affiliate Tracker agent by Wincer Song	WincerSong Agent v1.0
2352	Windows Media Player 10	Windows-Media-Player/10.00.00.xxxx
2353	Nicksoft WinGet download manager	WinGet 1.1
2354	Example code for a WinHTTP C++ library crawler	WinHTTP Example/1.0
2355	Wink beta search robot (64.13.136.x)	WinkBot/0.06 (Wink.com search engine web crawler; http://www.wink.com/Wink:WinkBot; winkbot@wink.com)
2356	WinPodder - Podcast player and RSS reader	WinPodder (http://winpodder.com)
2357	WinWap - Windows PC WAP browser	WinWAP/3.x (3.x.x.xx; Win32) (Google WAP Proxy/1.0)
2358	Yammba web directory (Germany) link checking	Wir sind die Borg (Version: 1.03, Sie wurden Assimiliert +http://www.yammba.com/suchmaschine/bot.html)
2359	WIRE crawler used by the University of Pisa - Italy	WIRE/0.11 (Linux; i686; Bot,Robot,Spider,Crawler,aromano@cli.di.unipi.it)
2360	WIRE - Web information retrieval environment crawler	WIRE/0.x (Linux; i686; Bot,Robot,Spider,Crawler)
2361	Korea Wisenut robot	WISEbot/1.0 (WISEbot@koreawisenut.com; http://wisebot.koreawisenut.com)
2362	Wisewire domain checker (Discontinued)	WiseWire-Spider2
2363	WISH academic research project for link checking	wish-project (http://wish.slis.tsukuba.ac.jp/)
2364	Wordchamp web page vocabulary / translation robot	WordChampBot
2365	WordPress personal Blog publishing platform	WordPress/x.x.x.x PHP/4.x.xx
2366	WORIO (beta) search for computer scientists and programmers using Heritrix open-source crawler	worio heritrix bot (+http://worio.com/)
2367	WORIO (beta) search for computer scientists and programmers via Amazon Web Services	woriobot ( http://www.worio.com/)
2368	Entireweb Search robot (62.13.25.xxx)	WorldLight
2369	unknown link checking (from 4.18.57.126) ?	WorQmada/1.0
2370	Wotbox spider	Wotbox/alpha0.6 (bot@wotbox.com; http://www.wotbox.com)
2371	Wotbox spider	Wotbox/alpha0.x.x (bot@wotbox.com; http://www.wotbox.com) Java/1.4.1_02
2372	WebSearchBench crawler from Dortmund University- Germany	WSB WebCrawler V1.0 (Beta)- cl@cs.uni-dortmund.de
2373	WebSearchBench crawler from Dortmund University- Germany	WSB, http://websearchbench.cs.uni-dortmund.de
2374	WUME Lab's web crawler (128.180.121.xxx)	wume_crawler/1.1 (http://wume.cse.lehigh.edu/~xiq204/crawler/)
2375	Wusage log-file analysis	Wusage/x.0@boutell.com
2376	WWLib - Wolverhampton Univerity Web Library for classifying web documents	Wwlib/Linux
2377	WWSBOT web server version checker	WWSBOT 1.x [--- http://www.analyzer.nu ---]
2378	Perl web page fetching module	WWW-Mechanize/1.1x
2379	Arianna robot	www.arianna.it
2380	Business-Socket.com link checking ?	www.business-socket.com registry verify/1.x
2381	The DoWeb UK Business directory link checking	www.doweb.co.uk crawler
2382	www4mail - web navigation & database search by e-mail	www4mail/2.x libwww-FM/2.14 (Unix; I)
2383	WWWC Updating check of Web pages. (Japanese only)	WWWC/1.0x
2384	World Wide Weasel Germany robot	WWWeasel Robot v1.00 (http://wwweasel.de)
2385	WWWoffle download manager	WWWOFFLE/2.x
2386	Unknown robot from CIS at Munich University	wwwster/1.x (Beta- mailto:gue@cis.uni-muenchen.de)
2387	wxDownload Fast (wxDFast) open source download manager	wxDownload Fast
2388	Arexera (Germany) crawler software	X-Crawler
2389	Xaldon WebSpider offline browser	Xaldon WebSpider
2390	Xenu link checker	Xenu Link Sleuth 1.xx
2391	Xenu link checker	Xenu's Link Sleuth 1.x[a-z]
2392	XerKa text mining and information retrieval software	Xerka WebBot v1.0.0 [UPVOpenDir]
2393	xine - free Linux / OS/2 multimedia player	xine/1.0
2394	XIRQ search (beta) robot (70.86.206.1xx)	xirq/0.1-beta (xirq; http://www.xirq.com; xirq@xirq.com)
2395	GPath / XMLSlurp - Expression language for tree structured data	XMLSlurp/0.1 libwww-perl/5.805
2396	Metamark URL Shorten Service	XRL/2.00b1 (Linux; i686; en-us) (+http://metamark.net/about)
2397	Xylix Retrieval System software	Xylix
2398	Inria Crawler	xyro_(xcrawler@cosmos.inria.fr)
2399	Yahoo Search Japan robot (211.14.8.2xx)	Y!J-BSC/1.0 (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
2400	Yahoo Search Japan robot (203.216.197.xxx)	Y!J-SRD/1.0
2401	Yahoo Search Japan robot (211.14.8.2xx)	Y!J/1.0 (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
2402	Yahoo picture service for mobiles	Y!OASIS/TEST no-ad Mozilla/4.08 [en] (X11; I; FreeBSD 2.2.8-STABLE i386)
2403	Y!TunnelPro - Yahoo! Messenger companion user agent	Y!TunnelPro
2404	Yacy distributed P2P web search engine robot	yacy (www.yacy.net; v20040602; i386 Linux 2.4.26-gentoo-r13; java 1.4.2_06; MET/en)
2405	Yacy distributed P2P web search engine robot	yacybot (x86 Windows XP 5.1; java 1.5.0_06; Europe/de) yacy.net
2406	(Yahoo) Pipes interactive data aggregator robot	Yahoo Pipes 1.0
2407	Yahoo Mindset: Intent-driven Search (66.228.182.1xx)	Yahoo! Mindset
2408	Yahoo blog indexing robot (209.191.83.1xx)	Yahoo-Blogs/v3.9 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html )
2409	Yahoo multimedia crawler (206.190.43.xx)	Yahoo-MMAudVid/1.0 (mms dash mmaudvidcrawler dash support at yahoo dash inc dot com)
2410	Yahoo multimedia crawler	Yahoo-MMAudVid/2.0(mms dash mm aud vid crawler dash support at yahoo dash inc.com ;Mozilla 4.0 compatible; MSIE 7.0;Windows NT 5.0; .NET CLR 2.0)
2411	Yahoo multimedia crawler via Fastsearch.net (66.77.73.xx)	Yahoo-MMCrawler/3.x (mm dash crawler at trd dot overture dot com)
2412	Yahoo Search robot	Yahoo-Test/4.0
2413	Yahoo crawler via Overture (66.77.73.3x)	Yahoo-VerticalCrawler-FormerWebCrawler/3.9 crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler
2414	Yahoo Publisher Network RSS crawler	YahooFeedSeeker/2.0 (compatible; Mozilla 4.0; MSIE 5.5; http://publisher.yahoo.com/rssguide)
2415	Yahoo Product Search crawler ( 68.142.195..x)	YahooSeeker-Testing/v3.9 (compatible; Mozilla 4.0; MSIE 5.5; http://search.yahoo.com/)
2416	Yahoo Product Search crawler ( 66.196.93.x)	YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/)
2417	Yahoo Product Search crawler ( 66.196.93.x)	YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://search.yahoo.com/yahooseeker.html)
2418	Yahoo Product Search crawler ( 66.196.93.x)	YahooSeeker/1.1 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/)
2419	Yahoo Product Search crawler ( 68.142.195..x)	YahooSeeker/bsv3.9 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html )
2420	Yahoo robot	YahooSeeker/CafeKelsa-dev (compatible; Konqueror/3.2; FreeBSD ;cafekelsa-dev-webmaster@yahoo-inc.com )
2421	Yandex Search Russia link checking (213.180.206.2xx)	Yandex/1.01.001 (compatible; Win16; I)
2422	Yanga search robot by Gigabase (Russian Federation)	Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
2423	Yarienavoir search (Belgium) robot	yarienavoir.net/0.2
2424	1noon.com search Korea robot (222.231.21.xxx)	Yeti
2425	1noon.com search Korea robot (222.231.21.xxx)	Yeti/0.01 (nhn/1noon, yetibot@naver.com, check robots.txt daily and follows it)
2426	Naver search (Korea) robot	Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
2427	yggdrasil spider for GoPubMed biorelated search engine	yggdrasil/Nutch-0.9 (yggdrasil biorelated search engine; www dot biotec dot tu minus dresden do de slash schroeder; heiko dot dietze at biotec dot tu minus dresden dot de)
2428	Yodao search (China)	YodaoBot/1.0 (http://www.yodao.com/help/webmaster/spider/; )
2429	Yoono - community based search (193.110.140.xxx / 194.0.179.[x]xx)	yoofind/yoofind-0.1-dev (yoono webcrawler; http://www.yoono.com ; MyEmail)
2430	Yoogli search (under development) agent	yoogliFetchAgent/0.1
2431	Yoono - community based search (193.110.140.xxx / 194.0.179.[x]xx)	yoono/1.0 web-crawler/1.0
2432	YottaCars bot - YottaCar car search engine ( 64.62.175.xxx)	YottaCars_Bot/4.12 (+http://www.yottacars.com) Car Search Engine
2433	YottaShopping bot - YottaShopping search engine ( 64.62.175.xxx)	YottaShopping_Bot/4.12 (+http://www.yottashopping.com) Shopping Search Engine
2434	Y!TunnelPro - Yahoo! Messenger companion user agent	YTunnelPro
2435	Z-Add online link checker	Z-Add Link Checker (http://w3.z-add.co.uk/linkcheck/)
2436	Zao crawler for Kototoi Project	Zao-Crawler
2437	Zao crawler for Kototoi Project	Zao-Crawler 0.2b
2438	Zao crawler for Kototoi Project	Zao/0.1 (http://www.kototoi.org/zao/)
2439	Zeus Internet Marketing Robot based on Webster Pro component	ZBot/1.00 (icaulfield@zeus.com)
2440	Zearchit German search / directory	Zearchit
2441	Ze.bz Moteur de Recherche robot	ZeBot_lseek.net (bot@ze.bz)
2442	Ze.bz Moteur de Recherche robot	ZeBot_www.ze.bz (ze.bz@hotmail.com)
2443	ZedZo Search (beta) robot	zedzo.digest/0.1 (http://www.zedzo.com/)
2444	Zend PHP frameworks Zend_Http_Client component	Zend_Http_Client
2445	Powerset Natural Language Search crawler (under development) using Heritrix via Amazon Web Services	zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com]
2446	Zerx search robot ?	zerxbot/Version 0.6 libwww-perl/5.79
2447	Zeus Internet Marketing Robot (based on Webster Pro)	Zeus ThemeSite Viewer Webster Pro V2.9 Win32
2448	Zeus Internet Marketing Robot (based on Webster Pro)	Zeus xxxxx Webster Pro V2.9 Win32
2449	Zeusbot robot for building the Ulsysseek.com index	Zeusbot/0.07 (Ulysseek's web-crawling robot; http://www.zeusbot.com; agent@zeusbot.com)
2450	Unknown agent (server- or link checking ?) from 198.173.158.xx	Ziggy -- The Clown From Hell!!
2451	Zipp.net web search robot	ZipppBot/0.xx (ZipppBot; http://www.zippp.net; webmaster@zippp.net)
2452	Zipp.net web search robot	ZIPPPCVS/0.xx (ZipppBot/.xx;http://www.zippp.net; webmaster@zippp.net)
2453	Zippyfinder robot	Zippy v2.0 - Zippyfinder.com
2454	Microsoft Zoo Tycoon 2 game client	Zoo Tycoon 2 Client -- http://www.zootycoon.com
2455	Zoom Search Engine software spider	ZoomSpider - wrensoft.com
2456	collecting for machine learning; http://zscho.de/ )	Zscho.de Crawler/Nutch-1.0-Zscho.de-semantic_patch (Zscho.de Crawler
2457	zspider robot for a new search engine	zspider/0.9-dev http://feedback.redkolibri.com/
2458	Wisenut robot	ZyBorg/1.0 (ZyBorg@WISEnut.com; http://www.WISEnut.com)
2459	FM Scene soccer fan pages plugin	Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (FM Scene 4.6.1)
2460	PrevX security plugin	Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729) (Prevx 3.0.5)