jasminecorp.net directory
Updated Blogs
More .....



 
 

| Add Search | Advertise With JCSearch | Suggest a Site

Search the Web


Search Results

Robots
Directory > Computers > Internet > Searching > Search Engines > Robots

Web Sitesi

Robots.txt Syntax Checker
Online tool for syntax verification to robots.txt files, provided by Simon Wilkinson.
http://www.sxw.org.uk/computing/robots/check.html
Reviews Rating: Not yet Rated Whois Check

HTTP User Agent Index
An alphabetical list of user agents and the deployer behind them, compiled by Christoph Rüegg.
http://www.siteware.ch/webresources/useragents/db.html
Reviews Rating: Not yet Rated Whois Check

The User-Agent Database
Icehouse has gathered a list of spiders (robots or crawlers), browsers and harvesters, sorted into
a searchable database.

http://www.icehousedesigns.com/useragents/
Reviews Rating: Not yet Rated Whois Check

Psychedelix List of User-Agents
Andreas Staeding's large list of search engine spiders, similar Web robots, and Web browsers: their
web-log identification and links to their originators.

http://www.psychedelix.com/agents.html
Reviews Rating: Not yet Rated Whois Check

Search Engine IP Addresses
Lists IP addresses of search engine spiders. Can be searched by IP address. Also links to resources
on spiders.

http://www.iplists.com/
Reviews Rating: Not yet Rated Whois Check

Robots, Spiders and Other User Agents: a Resource for WebMasters
José Luis Pellicer's searchable database of robots, spiders and other user agents for programs
that surf the web.

http://joseluis.pellicer.org/ua/
Reviews Rating: Not yet Rated Whois Check

All About Search Indexing Robots and Spiders
Search Tools Consulting explains how the search engine programs called "robots" or
"spiders" work, and reviews related sites.

http://www.searchtools.com/robots/
Reviews Rating: Not yet Rated Whois Check

List of Robot Agent Strings
A list from PGTS of Web robots with the identifying data they leave in Web site logs.
http://www.pgts.com.au/pgtsj/pgtsj0208d.html
Reviews Rating: Not yet Rated Whois Check

Search Engine Robots and Other User Agents
John A. Fotheringham presents data in tabular form on the robots sent by search engines and other
sites to read and index Web pages: their origins, names and IP addresses.

http://www.jafsoft.com/searchengines/webbots.html
Reviews Rating: Not yet Rated Whois Check

The Web Robots Pages
Martijn Koster's FAQs about the programmes that index the Web, how to direct visiting robots, a
database of robots, an archived mailing list, background reading, and related links.

http://www.robotstxt.org/
Reviews Rating: Not yet Rated Whois Check

 


Jasminecorp.net directory is based on the Open Directory and is being modified by Jasminecorp.

©2004 Jasmine Computers Inc.

Click here to subscribe for Jasminecorp's product News.

Home | JCBid |Software Development | Domain Registration | Hosting | Web Designing | Buy Books | Advertise with JCSearch | Whois | IP Locator | Add Search | Shopping | Store | Free Blogs | Free GuestBook | Free E-Cards | Free Games | Free Tutorials | Set as Home | Add to Favorite | Suggest a Site | Directory | Our Portfolio | Terms of service | Free quote | Tell a Friend | Special Offer | Job Opportunities | games | Usenet Groups

Submit a Site to Jasminecorp.net Directory || Advertise with us

 

Help build the largest human-edited directory on the web.
Submit a Site - Open Directory Project - Become an Editor
Get a Domain Name:
.com .us .info
.org .in .name
.net .biz .asia