How does the search robot
On this subject there is a detailed faq on Yandex at http://help.yandex.ru/webmaster/?id=995296
Detailed, but not informative enough. For example, a direct question, and given himself: "What is the search engine robot and what is he doing?" Yandex himself and says:
Robot (English crawler) maintains a list of URL, it can index and regularly pumps out the corresponding documents. If the robot detects an analysis of the document [...]
Pp. 1 of 1 1