Hvassing.com

Since the World Wide Web has so many users, sites and pages it is constantly developing. A page that was displayed yesterday may either be deleted or updated tomorrow. As a direct result of this the search engines have to visit the pages quite frequent in order to be able to display an accurate search result. Crawling each of the Webs ten billion pages every day would consume enormous amounts of computer resources so most search engines tends to forget all the pages and site which haven’t been updated for the past two years. So, after two year information that may be highly relevant for a new search query they still wouldn’t be displayed as it is no longer in the search engine’s database.

When searching for the term “computer software” in Google you get approximately 376,000,000 results, MSN finds 199,003,902 pages whereas Yahoo finds 188,000,000 pages matching my criteria. They all show me the first ten results found and in most cases the user will settle for one of these and not chose to see the rest of the search results. Effectively what this means is that if you’re not on the first page you do not exist on the Web for most users.

Posted only so that I can cite it...