Skip to Main Content

Finding Information on the Web: Choose a Search Engine

Using the Internet for Research? How can you tell if the stuff on the Web is good to use in your class assignment?
Subjects: Computer Science

How to Choose a Search Engine?

CHOOSING A SEARCH ENGINE

Search engines are used to perform keyword searches in large databases of information culled from the Internet. To effectively use any type of search engines, it is important to understand what they are, how they work, and how they differ. When searching for sources to use for  research purposes, note that the online databases supplied by the Kinlaw Library through www.asbury.edu/library and the materials in the Library Online Catalog have already been carefully evaluated by librarians.  Librarians have also reviewed the web sites listed on the Resources by Subject pages at: http://www.asbury.edu/library/   Those resources are recommended to be used in conjunction with general searches done on the Internet.

Search engines can be grouped into four distinct categories (active, passive, meta, and specialized).  Each search engine will perform differently based on its underlying techniques.  It is important to know how a search engine works as that will affect the types of results that are produced.  In the boxes to the right are listed the four types of search engines with examples for each type.

Lists of Selected Sites

Some places have pre-evaluated and grouped web sites.  These are usually vetted for the quality of the information they will contain.  Then they are organized into some kind of subject structure.

 Digital Librarian - this is a listing of pre-selected sites.  Arranged by subject.

Berkeley has a great chart looking at three large search engines - evaluate them:  http://www.lib.berkeley.edu/TeachingLib/Guides/Internet/SearchEngines.html

Difference between a Search Engine and a Library Database

What are the differences?  Which one is better for your search?   Why should you choose one or the other?  Look at these sites for details.

Library Databases vs. Search Engines

How do they Compare?

Meta Search Engines

Meta Search Engines

Meta search engines do not create their own databases. They rely on existing active search engine indexes to retrieve search results.  In a meta-search, keywords are submitted to the individual search engines and they are searched simultaneously.  Since most meta-search tools only retrieve the top 10-50 hits from each search engine, the total number of hits retrieved may be considerably less than found by doing a direct search on one of the search engines.  Some meta-searches offer the ability to customize which search engines are queried.  The result list will be sorted according to ranking features or in some kind of lumping format.  Some "smarter" meta-searching technology includes clustering and linguistic analysis that attempts to show themes within results, with some fancy textual analysis and display that can help you dig deeply into a set of results.  Use these with caution and be sure to check the features of the meta-search engine before using.

Advantages

  • Remove most duplication from search results.
  • Save users time by searching several search engines at once.

Disadvantages

  • Redundancies can occur in search results.
  • Displayed results are often confusing.
  • It is not always clear how the search system works.
  • Possibility that they are not very thorough or exclude major search engines.

Examples

Active Search Engines

Active (Robot Generated) Search Engines [quantity over quality]

Active search engines rely on computerized retrieval mechanisms. Referred to as "spiders", "crawlers", or "robots", these mechanisms visit Web sites and retrieve relevant keywords to index and store in a searchable database.

Advantages

  • Large number of results in one place.
  • Provide a ranking of search results based on relevancy.
  • Useful for finding information on organizations, groups, and personal web pages related to a topic.

Disadvantages

  • Rankings are sometimes questionable because they are computer-generated rather than human produced.
  • Lack of human involvement can lead to poor quality control.
  • Constantly changing links and content.

Examples

Passive Search Engines

Passive (Human Selected) Search Engines [quality over quantity]

Passive search engines, often referred to as directories, are human controlled and do not roam the Web directly. They rely on individual submissions that are reviewed and indexed by subject category.

Advantages

  • Provide users with a subject directory and a short description of each site.
  • Human involvement usually produces a higher relevancy of results.

Disadvantages

  • Contain far fewer records than active search engines.

Examples

Specialized Search Engines

Specialized Search Engines

Specialized search engines offer additional features that active, passive and meta search engines do not provide.

RedZ - http://redz.com/home

  • Visual presentation of results.
  • Shows results based on relevancy.
  • Default view shows screenshots of web pages.

Ask - http://www.ask.com

  • Allows users to pose search requests in the form of questions rather than keywords.
  • Attempts to direct users to the exact page or pages that answers the question.
  • Has a back-up metacrawler component that will search other indexes if a match is not found within its own database.

One Page Mega Search  - http://www.bjorgul.com/

  • Single page with many search boxes.
  • Offers many choices not listed elsewhere.

Visual Display of Search results - http://www.oolone.com/index.aspx

  • Items are arranged according to relationship.

Privacy when searching - http://www.duckduckgo.com/

  • Protects user privacy and avoids filter bubbles.
  • Can select types of content to narrow search results.

Different search ranking - https://www.blippex.org

  • Protects user privacy.
  • Ranks results by "dwell time".

Search for people - https://www.pipl.com

  • Searches public records.

Computational knowledge engine - http://www.wolframalpha.com

  • Factual and equational results.