Web Search Engines & Directories
According to a 2007 report by Netcraft, 108,810,358 distinct Web sites make up the World Wide Web. When you want to find out more about a specific topic, service or product, you use an Internet search engine. Today there are a number of search engines, and while they work differently, they all use Webcrawlers (also called bots) that are designed to index pages on the Web and also words found on these pages. The indexing of the Web enables is what enables users to search for keywords or combinations of words to find information online.
Other types of search engines are called search directories. They site index content chosen by human editors, rather than automated indexing done by bots. Today most search engines offer complementary search-related products such as shopping search, news and other services that go beyond the basic keyword search function.
The following Quick Reference provides an overview of some of the more popular public Web Search Engines and Directories, including details on their history, information on how they work and tips for using each.
BingBing is a new search engine from Microsoft that was launched on May 28, 2009. Microsoft calls it a "Decision Engine," because it's designed to return search results in a format that organizes answers to address your needs. When you search on Bing, in addition to providing relevant search results, the search engine also shows a list of related searches on the left-hand side of the search engine results page (SERP). You can also access a quick link to see recent search history. Bing uses technology from a company called Powerset, which Microsoft acquired.
Bing launched with several features that are unique in the search market. For example, when you mouse-over a Bing result a small pop-up provides additional information for that result, including a contact e-mail address if available. The main search box features suggestions as you type, and Bing's travel search is touted as being the best on the net. Bing is expected to replace Microsoft Live Search.
Bing Search Tips:
Google's search engine crawler, called the GoogleBot, travels from Web page to Web page following hyperlinks. When a new page is found, Googlebot will also crawl all the hyperlinks on that page as well. A second bot also crawls indexed pages to keep the index updated. As pages are indexed, they are also given scores based on criteria like how many times words are displayed (density), link popularity, HTML code, themes, content (the text) and more. These scores are what determines where the Web page listing appears in the search results.
Google also offers content-specific searches for Blogs, Books, Video, Images, Maps, Local, Mobile and country-specific searches. It is much more than search. It's blogging, mapping, hopping, research and more. Use this Webopedia Google Products & Services Quick Reference to get a grip on Google and its many services.
Google Search Tips:
YahooFounded in 1994 by David Filo and Jerry Yang, Yahoo was initially a directory of Web sites categorized by human editors, a directory for which it is still most well-known for today. Over time Yahoo began acquiring search companies and combining the technologies. In 2004 Yahoo acquired the Overture pay-per-click service (which had bought AltaVista and AlltheWeb), as well as the Inktomi search database and others. These search technologies and tools combined makes yahoo what it is today, making Yahoo's infamous directory search secondary to its main search engine.
The Yahoo Search index is made up of billions of Web pages, which are populated by a Web crawler. When Yahoo crawls pages it takes several factors into consideration. The search terms included in the page's Title and Description tag, page content (the text), keyword density, inbound hyperlinks and so on. Yahoo has also started using page rank technologies and also takes Yahoo Directory listings and paid inclusions into consideration when indexing and ranking pages. Users can submit their own pages directly to the Yahoo Search index and the Yahoo Directory, and also submit products for inclusion in Yahoo Shopping. Yahoo has also incorporated special search and services such as Webmail, Local, video, images, shopping and news search products.
Yahoo Search Tips:
Windows Live SearchMicrosoft's search engine, Windows Live Search offers a huge improvement over MSN Search and is also integrated into Microsoft's Live.com. When it launched September 12, 2006, it was a new search engine built from scratch using a new algorithmic engine that was integrated throughout Windows Live and MSN. Some of the features of Windows Live Search include a nice feature-rich interface — something new and unique in the Web search space. By signing in to a personalized Live search you can add feeds and subscribe to search results. Windows Live Search also incorporates specific searches for images, news, academic journals, RSS feeds, maps and more.
Live Search technologies attempt to overcome some elements of human error, such as spelling errors, punctuation and synonyms and also predicts with the intent of providing the best search results possible for users. To improve ranking in Microsoft Live Search you can mark your front page as accessible to those with specialist settings on their browser, keyword density is a factor, include an HTML site map and also use a distinct list of keyword meta tags for each page on your site.
Windows Live Search Tips:
From the widest view, everything that we include under the heading of mobile has irrevocably changed IT's relationship with the rest of the... Read More »Choosing an Enterprise Storage Implementation
When you deploy a new enterprise storage system, you must decide whether to design and build your own storage system or to utilize a cloud-based... Read More »Big Data Analytics Expert Predictions
In this Webopedia Did You Know...? article we look at three big data expert predictions for 2014. Read More »
- Enterprise Mobility Exchange results show continued growth and emphasis on mobility. CIOInsight breaks down the numbers here. »
- Watch Datamation's editor James Maguire moderate roundtable discussions with tech experts from companies such as Accenture, Dell, Blue Jeans Network, Microsoft and more »
Keeping track of big data trends, research and statistics gives IT professionals a solid foundation to plan big data projects. Here are 15... Read More »Enterprise Storage Vendors
There's a number of vendors that sell enterprise storage hardware or offer cloud-based enterprise storage. View Webopedia's Enterprise storage... Read More »50 Cloud Computing Terms Defined
From planning a private cloud project to finding an online cloud storage provider, Webopedia's A-Z Cloud Computing Glossary will help you... Read More »