Crawler

Comments are off

A software program which visits virtually all pages of the Web to create indexes for Search engines. Crawlers ‘read’ text files than graphic files. (See also spider and bot).