Webcrawler - Robots - Liste

hier ist mal ne liste der bekanntesten crawler. werde die liste ständig aktualisieren. anhand dieser liste könnt ihr eure eigenen webprojekte bei den jeweiligen suchmaschinen anmelden. damit ihr nicht auf diese unseriösen "anmeldung in 200 suchmaschinen kostenlos" dienste zurückgreifen müsst. da steht nämlich nie, dass die automatisch deine emailadresse an die 200 "suchmaschinen" übermitteln

Google
Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Googlebot/2.1 (+http://www.google.com/bot.html)
Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)
Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html)

AltaVista
Scooter/3.3.vscooter
Scooter/3.3Y!CrawlX
Scooter/3.3_SF
Scooter/3.3
Scooter/3.2

Overture
Yahoo-MMCrawler/3.x (mm dash crawler at trd dot overture dot com)
FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler)

Yahoo
Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com)
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

Microsoft Network - MSN
msnbot/0.11 (+http://search.msn.com/msnbot.htm)
F
AST
FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
FAST Enterprise Crawler/6 (www.fastsearch.com)

NPBot http://www.nameprotect.com/botinfo.html
Gigabot/1.0
Gigabot/2.0
NameProtect Inc. web crawler. NPBot ( http://www.nameprotect.com/botinfo.html)

Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)

Steeler/1.3 ( http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)

Mozilla/2.0 (compatible; Ask Jeeves/Teoma)

ia_archiver
ia_archiver-web.archive.org
DoCoMo/1.0/P504iS/c10/TB
http://www.almaden.ibm.com/cs/crawler [c01]
sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
ZyBorg/1.0 (wn-2.zyborg@looksmart.net; http://www.WISEnutbot.com)
CipinetBot (http://www.cipinet.com/bot.html)
QuepasaCreep v0.9.13 and QuepasaCreep v0.9.14
QuepasaCreep ( crawler@quepasacorp.com )
larbin_2.6.2 (larbin2.6.2@unspecified.mail)
eseek-larbin_2.6.2 (crawler@exactseek.com)
larbin_2.6.3 (larbin2.6.3@unspecified.mail)
Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+ http://gais.cs.ccu.edu.tw/robot.php)
SearchSpider/1.2.10 AND ALSO SearchSpider.com/1.1
COMBINE/0.0
Girafabot; girafabot at girafa dot com; http://www.girafa.com)
Vagabondo/2.0 MT (webagent at wise-guys dot nl)
Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
SpiderKU/0.9
IXE Crawler
BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686)
spider@spider.ilab.sztaki.hu (Computer_and_Automation_Research_Institute_Crawle r)
Dattatec.com-Sitios-Top (abuse@hostmar.com)
skysearch.net from
dloader(NaverRobot)/1.5
minibot(NaverRobot)/1.0
NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
QPCreep Test Rig ( We are not indexing, just testing )
appie 1.1 (www.walhello.com)
iw5Spider (http://www.internet-work.com/iw5spider.htm)
Dumbot(version 0.1 beta)
Dumbot(version 0.1 beta - dumbfind.com)
Cowbot-0.1.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html)
TurnitinBot/2.0 (http://www.turnitin.com/robot/crawlerinfo.html)
SurveyBot/2.3 (Whois Source) http://www.whois.sc/
SnykeBot/0.6 (http://www.snyke.com)
lachesis
Bumblebee@relevare.com
Zao/0.2 (http://www.kototoi.org/zao/)
LinkAlarm/2.4
LinkWalker www.seventwentyfour.com
psbot/0.1 (+http://www.picsearch.com/bot.html )
Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)
Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler)
RoboCrawl (www.canadiancontent.net)
Fetcher/0.99 RPT-HTTPClient/0.3-3E
Butch__2.1.1 (agdm79@mail.ru)
Iltrovatore-Setaccio
IlTrovatore-Setaccio/1.2 (Indexing; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it)
Python-urllib/1.15
WebReaper v9.8 - www.webreaper.net
http://www.thebananatree.org
NCSA Beta 1 (http://vias.ncsa.uiuc.edu/viasarchivinginformation.html)
Pompos/1.3 http://dir.com/pompos.html
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Welcome to Intrepid Travel; .NET CLR
Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)
mozDex/0.04-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com)
Opencontent-Syndication (example@example.org)
RobotAgent
Baiduspider+(+http://www.baidu.com/search/spider.htm)
Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)
GetRight/4.5e
ObjectsSearch/0.01 (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)
ObjectsSearch/0.05 (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)
Mozilla/4.0 (compatible; Synapse)
Spinne/2.0
Exalead NG/MimeLive Client (convert/http/0.126)
Aport
WebFilter Robot 1.0
CrawlConvera0.1 (www.authoritativeweb.com)
http://www.ultraknowledge.com/spider
TheUsefulbot_2.3.62 (bot@theusefulnet.com)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot)
Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt)
Mackster( http://www.ukwizz.com )
Wotbox/alpha0.6 (bot@wotbox.com; http://www.wotbox.com)
IconSurf/2.0 favicon finder (see http://iconsurf.com/robot.html)
IconSurf/2.0 favicon monitor (see http://iconsurf.com/robot.html)
vspider
Jetbot/1.0 (http://www.jeteye.com/jetbot.html)
NetMechanic V4.0
Zeus 92621 Webster Pro V2.9 Win32
Zeus 81394 Webster Pro V2.9 Win32

hier ein paar links zu eintragsseiten:

http://www.google.de/intl/de/addurl.html
http://www.alltheweb.com/help/webmaster/submit_site
http://dmoz.org/World/Deutsch/
http://funktionen.abacho.de/seite_anmelden/
http://www.allesklar.de/
http://bellnet.de/suchen/anmeldungsseite.html
http://www.nathan.de/cgi-bin/displa...=10082004207229
http://www.abadoor.com/url_eintrag/
http://www.acoon.de/addurl.asp
http://www.alluna.de/url-suchmaschineneintrag.shtml

sehr feine idee...sowas lob ich mir...