spider Last modified: Wednesday, March 03, 2004
A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler. Because most Web pages contain links to other pages, a spider can start almost anywhere. As soon as it sees a link to another page, it goes off and fetches it. Large search engines, like Alta Vista, have many spiders working in parallel. Also see How Web Search Engines Work in the Did You Know . . . ? section of Webopedia.
•E-mail this definition to a colleague• Sponsored listings McGrawHill Construction: Online at Sweets.com - Research Spider and manufacturers in a library of more than 1,800 building product catalogs. Visit us today! Web Site Search Software - Compare Enterprise Search Software using Capterra's free, comprehensive directory. Web Site Search Functionality - Drastically improve the user experience on your website or intranet with the ISYS suite of search, navigation and discovery software. Free trial! For internet.com pages about spider . Also check out the following links! Making Your Pages Easy for Search Engines to Index  Achieving high rankings for Web sites on search engines has become a black art. An article from the Web Developer's Virtual Library. Invite Search Engine Spiders Into Your Dynamic Web Site Increase the traffic to your dynamic site by making your valuable content visible to search engine spiders. LiveLink Spider home page Describes LiveLink Spider, the crawler software used in the Open Text Index, available from Open Text Corporation. Optimization for Dynamic Web Sites With just a few quick selections by the user visiting your site, a page can be generated on the fly based on nothing more than the user's specific interest or request. Yahoo!'s web searching robots and spiders page Yahoo!'s directory of web searching robots and spiders. Sponsored listings Web Site Search Functionality - Find Spider Solutions and Compare prices at Shopica.com. Start Now! Find Local Contractors Here! - Find Local Contractors at Service Magic. Our Service is Quick, Free, & No Obligation Required. Get Contractors to Compete for Your Business! Promotional Stress Balls & Stress Relievers (10% Off) - Provides a variety of stress balls, including sports shapes, animal shapes, computers, vehicles, and more. Over 1,200 stress relievers to choose from.	Search Engines World Wide Web Alta Vista cloaking dynamic URL link farming pagejacking query string robot search engine SEO SERP site map spider trap Give Us Your Feedback Shopping spider Products Compare Products,Prices and Stores Shop by Category: Toys 1125 Store Offers Clothing 1369 Store Offers Shoes 382 Store Offers Lighting 1046 Store Offers Sport and Outdoor 377 Store Offers