internet.com
You are in the: Small Business Computing Channelarrow
Small Business Technology
» ECommerce-Guide | Small Business Computing | Webopedia | WinPlanet |Refer-It
Webopedia.com
Enter a word for a definition... ...or choose a computer category.
 
 

menu
   Home
   Term of the Day
   New Terms
   Pronunciation
   New Links
   Quick Reference
   Did You Know?
   Categories
   Tech Support
   Technology Jobs
   About Us
   Link to Us
   Advertising

   rss/xmlrss/xml  

Become a Marketplace Partner



talk to us
   Submit a URL
   Suggest a Term
   Report an Error

internet.com
IT
Developer
Internet News
Small Business
Personal Technology
International

Search internet.com
Advertise
Corporate Info
Newsletters
Tech Jobs
E-mail Offers
commerce
  Be a Commerce Partner
 
 
 
 
 
 
 
 
 
 
 
 
 
 

spider
Last modified: Wednesday, March 03, 2004 

A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler.

Because most Web pages contain links to other pages, a spider can start almost anywhere. As soon as it sees a link to another page, it goes off and fetches it. Large search engines, like Alta Vista, have many spiders working in parallel.

Also see How Web Search Engines Work in the Did You Know . . . ? section of Webopedia.

E-mail this definition to a colleague

Sponsored listings

McGrawHill Construction: Online at Sweets.com - Research Spider and manufacturers in a library of more than 1,800 building product catalogs. Visit us today!

Web Site Search Software - Compare Enterprise Search Software using Capterra's free, comprehensive directory.

Web Site Search Functionality - Drastically improve the user experience on your website or intranet with the ISYS suite of search, navigation and discovery software. Free trial!


For internet.com pages about spider . Also check out the following links!

Related Links

Making Your Pages Easy for Search Engines to Index 
Achieving high rankings for Web sites on search engines has become a black art. An article from the Web Developer's Virtual Library.

Invite Search Engine Spiders Into Your Dynamic Web Site
Increase the traffic to your dynamic site by making your valuable content visible to search engine spiders.

LiveLink Spider home page
Describes LiveLink Spider, the crawler software used in the Open Text Index, available from Open Text Corporation.

Optimization for Dynamic Web Sites
With just a few quick selections by the user visiting your site, a page can be generated on the fly based on nothing more than the user's specific interest or request.

Yahoo!'s web searching robots and spiders page
Yahoo!'s directory of web searching robots and spiders.

Sponsored listings

Web Site Search Functionality - Find Spider Solutions and Compare prices at Shopica.com. Start Now!

Find Local Contractors Here! - Find Local Contractors at Service Magic. Our Service is Quick, Free, & No Obligation Required. Get Contractors to Compete for Your Business!

Promotional Stress Balls & Stress Relievers (10% Off) - Provides a variety of stress balls, including sports shapes, animal shapes, computers, vehicles, and more. Over 1,200 stress relievers to choose from.

related categories

Search Engines

World Wide Web

related terms

Alta Vista

cloaking

dynamic URL

link farming

pagejacking

query string

robot

search engine

SEO

SERP

site map

spider trap


webopedia
Give Us Your
Feedback


Shopping
spider Products
Compare Products,Prices and Stores

Shop by Category:
Toys
1125 Store Offers

Clothing
1369 Store Offers

Shoes
382 Store Offers

Lighting
1046 Store Offers

Sport and Outdoor
377 Store Offers




JupiterOnlineMedia

internet.comearthweb.comDevx.commediabistro.comGraphics.com

Search:

Jupitermedia Corporation has two divisions: Jupiterimages and JupiterOnlineMedia

Jupitermedia Corporate Info


Legal Notices, Licensing, Reprints, & Permissions, Privacy Policy.

Advertise | Newsletters | Tech Jobs | Shopping | E-mail Offers

Solutions
Whitepapers and eBooks
Microsoft Article: Will Hyper-V Make VMware This Decade's Netscape?
Microsoft Article: 7.0, Microsoft's Lucky Version?
Microsoft Article: Hyper-V--The Killer Feature in Windows Server 2008
Avaya Article: How to Feed Data into the Avaya Event Processor
Microsoft Article: Install What You Need with Windows Server 2008
HP eBook: Putting the Green into IT
Whitepaper: HP Integrated Citrix XenServer for HP ProLiant Servers
Intel Go Parallel Portal: Interview with C++ Guru Herb Sutter, Part 1
Intel Go Parallel Portal: Interview with C++ Guru Herb Sutter, Part 2--The Future of Concurrency
Avaya Article: Setting Up a SIP A/S Development Environment
IBM Article: How Cool Is Your Data Center?
Microsoft Article: Managing Virtual Machines with Microsoft System Center
HP eBook: Storage Networking , Part 1
Microsoft Article: Solving Data Center Complexity with Microsoft System Center Configuration Manager 2007
MORE WHITEPAPERS, EBOOKS, AND ARTICLES
Webcasts
Intel Video: Are Multi-core Processors Here to Stay?
On-Demand Webcast: Five Virtualization Trends to Watch
HP Video: Page Cost Calculator
Intel Video: APIs for Parallel Programming
HP Webcast: Storage Is Changing Fast - Be Ready or Be Left Behind
Microsoft Silverlight Video: Creating Fading Controls with Expression Design and Expression Blend 2
MORE WEBCASTS, PODCASTS, AND VIDEOS
Downloads and eKits
Sun Download: Solaris 8 Migration Assistant
Sybase Download: SQL Anywhere Developer Edition
Red Gate Download: SQL Backup Pro and free DBA Best Practices eBook
Red Gate Download: SQL Compare Pro 6
Iron Speed Designer Application Generator
MORE DOWNLOADS, EKITS, AND FREE TRIALS
Tutorials and Demos
How-to-Article: Preparing for Hyper-Threading Technology and Dual Core Technology
eTouch PDF: Conquering the Tyranny of E-Mail and Word Processors
IBM Article: Collaborating in the High-Performance Workplace
HP Demo: StorageWorks EVA4400
Intel Featured Algorhythm: Intel Threading Building Blocks--The Pipeline Class
Microsoft How-to Article: Get Going with Silverlight and Windows Live
MORE TUTORIALS, DEMOS AND STEP-BY-STEP GUIDES