Dominic
Vautier
8-2022
When things get published on the web there are programs that are constantly going through it looking for new stuff. This is very important to businesses and researchers alike because new data is becoming available all the time. It is also good for advertisers and governments, well probably not always so good for us. But a whole industry is dedicated to how to get noticed by the search engines. Businesses pay web designers big money to get that coveted hot spot on the top of search results. see "vautier home page" as an example.
Google was the pioneer in this field and they keep their algorithms closely guarded. It is only by careful research that designers know what the googlers use and besides, the search algorithms keep changing.
I know of several techniques that will attract the attention of the crawlers but most techniques have been well discussed on the web already and well published.