Everything You Need to Know About Search Engines

What is a search engine? And how do search engines work?

Pensive Hispanic man using computer in library
Marc Romanelli/Getty Images

A search engine is a software program that searches for websites based on the words that you designate as search terms. Search engines look through their own databases of information in order to find what it is that you are looking for.

Are Search Engines and Directories the Same?

Search engines and web directories are not the same things; although the term search engine often is used interchangeably. Sometimes, people even confuse web browsers with search engines. (Hint: Those are completely different things!)

Search engines automatically create website listings by using spiders that "crawl" web pages, index their information, and optimally follows that site's links to other pages. Spiders return to already-crawled sites on a pretty regular basis in order to check for updates or changes, and everything that these spiders find goes into the search engine database.

Understanding Search Crawlers

A spider, also known as a robot or a crawler, is actually just a program that follows, or crawls, links throughout the Internet, grabbing content from sites and adding it to search engine indexes.

Spiders only can follow links from one page to another and from one site to another. That is the primary reason why links to your site (inbound links) are so important. Links to your website from other websites will give the search engine spiders more food to chew on. The more times they find links to your site, the more times they will stop by and visit. Google especially relies on its spiders to create their vast index of listings.

Spiders find web pages by following links from other web pages, but users can also submit web pages directly to a search engine or directory and request a visit by their spiders. In fact, it's a good idea to manually submit your site to a human-edited directory such as Yahoo!, and usually spiders from other search engines (such as Google) will find it and add it to their database.

It can be useful to submit your URL straight to the various search engines as well; but spider-based engines will usually pick up your site regardless of whether or not you've submitted it to a search engine. It should be noted that most sites are picked up automatically upon publishing by search engine spiders, but manual submission is still practiced. 

How Do Search Engines Process Searches? 

Search engines are not simple. They include incredibly detailed processes and methodologies, and are updated all the time. This is a bare bones look at how search engines work to retrieve your search results.

All search engines go by this basic process when conducting search processes, but because there are differences in search engines, there are bound to be different results depending on which engine you use.

  1. The searcher types a query into a search engine.

  2. Search engine software quickly sorts through literally millions of pages in its database to find matches to this query.

  3. The search engine results are ranked in order of relevancy.

Examples of Search Engines

There are a ton of great search engines out there for you to choose from. Whatever your search need might be, you'll find a search engine to meet it.

  • All-purpose search engines, visual search engines, people search engines... you'll find all these and more in this list of search engines; a comprehensive guide to the best search engines on the web.
  • Pick the best search engine for your searching needs. This article includes links to numerous search engines which gives you a great way to explore more about your search topic, try a new search engine, and search more of the web.