Appearing near the top of the search engines and grabbing the attention of the target audience is the top priority of all websites. For business purposes, optimizing web pages is a must. One of the top priorities of the websites is to please the eyes of the viewers by providing good look and feel and thereby attract customers. Websites are thus optimized, in order to reach the higher ranks for better public visibility and access. And this can be achieved through carefully chosen Keywords, Title, Image Alt text, Text and overall design. These components of a web page should be paid close attention to when preparing it for listing in a Search Engine.
Search engines are no human brains. They cannot make judgments of any kind when they face a not toward question; like a vague and unspecific keyword like “Movies”. Then how do search engines exactly work? They follow a set of rules, known as an algorithm which works according to closely-kept trade secret. However, all search engines observe the following general rules:
a) Location and frequency of Keywords used: In order to search for anything related to “Movies” as mentioned earlier, the search engine first visits the web pages which have the keyword used in their domain. For example:
Hence we can see that , one of the main rules in a ranking algorithm involves the location and frequency of keywords on a web page. Those pages which have the search terms appearing in the HTML title tag are often assumed to be more relevant than others to the topic. Then the search engines check for the keywords or key phrases in the page linearly.
a) The scene is not same for all: The same search on different search engines produces different results. This is because different search engines have different priorities and varied business rules.
this is the search result for the word “food” on google.
this is the search result for the same word in yahoo. Here we can see the difference in results.
Search engines may penalize pages or remove them from the index, if they detect "spamming." For example, an over-repetitions of words in order to propel the page higher in the listings. Search engines keep a watch on common spamming methods in a variety of ways, without undermining the user complaints.
c) Link Analysis: Search Engines analyze how pages link to each other; it can determine both what a page is about and whether that page is to be considered "important" and thus deserving of a ranking boost. Moreover, sophisticated techniques are devised to bring to knowledge attempts to build "artificial" links designed to boost rankings.
In addition, there are the crawler of AllTheWeb, AltaVista, Google, Bing, Yahoo, Inktomi and Teoma like;
Deep Crawl: supported by AllTheWeb, Google, Inktomy, Bing.
Robot.txt: AllTheWeb, Google, Yahoo, Bing, Inktomy, Teoma, Alta Vista.
Full Body Text: AllTheWeb, Google, Inktomy, Teoma, Alta Vista, Bing.
Stop Words: AltaVista, Inktomy, Google, Bing.
Meta Description: AllTheWeb, Google, Inktomy, Teoma, Alta Vista, Bing.
Alt Text: AltaVista, Teoma, Google, Bing.