Different types of search engines

When people talk about the term “search engine”, it is often used generically to explain both crawler-based search engines and human-powered web directories. In fact, these two types of search engines gather their listings in very different ways and therefore are inherently different.

Crawler-based search engines, such as GoogleAllTheWeb and AltaVista, create their data listings automatically by using a piece of software to “crawl” or “spider” the web and then index what it finds to build the search database. Web page changes can be dynamically caught by crawler-based search engines and will affect how these web pages get listed in the search results.

Crawler-based search engines are good when you have a specific search topic in mind and can be very efficient in finding relevant information in this situation. However, when the search topic is general, crawler-base search engines may return hundreds of thousands of irrelevant responses to simple search requests, including lengthy documents in which your keyword appears only once.

Human-powered directories, such as the Yahoo directoryOpen Directory and LookSmart, depend on human editors to create their listings. Typically, webmasters submit a short description to the directory for their websites, or editors write one for the sites they review, and these manually edited descriptions will form the search base. Therefore, changes made to individual web pages will have no effect on how these pages get listed in the search results.

Human-powered directories are good when you are interested in a general topic of search. In this situation, a directory can guide and help you narrow your search and get refined results. Therefore, search results found in a human-powered directory are usually more relevant to the search topic and more accurate. However, this is not an efficient way to find information when a specific search topic is in mind.

summarizes the different types of the major search engines.

Search EnginesTypes
GoogleCrawler-based search engine
AllTheWebCrawler-based search engine
TeomaCrawler-based search engine
InktomiCrawler-based search engine
AltaVistaCrawler-based search engine
LookSmartHuman-Powered Directory
Open DirectoryHuman-Powered Directory
YahooHuman-Powered Directory, also provide crawler-based search results powered byGoogle
MSN SearchHuman-Powered Directory powered byLookSmart, also provide crawler-based search results powered by Inktomi
AOL SearchProvide crawler-based search results powered by Google
AskJeevesProvide crawler-based search results powered by Teoma
HotBotProvide crawler-based search results powered by AllTheWebGoogleInktomiand Teoma, “4-in-1” search engine
LycosProvide crawler-based search results powered by AllTheWeb
Netscape SearchProvide crawler-based search results powered by Google

From the table above we can see that some search engines like Yahoo and MSN Search provide both crawler-based results and human-powered listings, therefore become hybrid search engines. A hybrid search engine will still favor one type of listings over another as its type of main results.

There is another type of search engines that is called meta-search engines.

Meta-search engines, such as DogpileMamma, and Metacrawler, transmit user-supplied keywords simultaneously to several individual search engines to actually carry out the search. Search results returned from all the search engines can be integrated, duplicates can be eliminated and additional features such as clustering by subjects within the search results can be implemented by meta-search engines.

Meta-search engines are good for saving time by searching only in one place and sparing the need to use and learn several separate search engines. “But since meta-search engines do not allow for input of many search variables, their best use is to find hits on obscure items or to see if something can be found using the Internet.”

FTC Disclosure: This site contains affiliate links to products & services and we may receive a commission for purchases made through these links without any additional cost to you.

About the Author Kalyani Kumari

A content marketer having experience in content writing. The passion of writing and reading leads me to become a content writer. My passion is the driving force behind writing the blogs.



Get All The Practical Steps, Tools, Training, And Support You Need To Start A Blog Quickly And Easily...for FREE





Start My FREE 8-Days Blogging Training Today!

I know, you might have thought about starting a blog but never took an action.

In fact, one of the biggest reasons why many bloggers don't even get off the ground is because they suffer from analysis paralysis and they fee lack of confidence when it comes to something online.

I was at your stage 2 years back. But today I am a successful blogger living a freelance lifestyle.

So I have created the 8 Days Blogging Series.

The free 8 Days Blogging Series is meant to give you an overview of successful blogging that nobody else can provide.

For the next 8 days, you are going to get actionable and interesting step by step guide & tips to start your blog.


→ Start the Free 8-Day Blogging Training ←




error: Content is protected !!