What is a crawler?
Are you preparing for IT certification? With practice questions, study notes, interactive quizzes, tips and technical articles, uCertify PrepKits ensure that you get a solid grasp of core technical concepts to ace your certification exam in first attempt.
What is a crawler?
Rating:
A crawler is a software component of a search engine. It explores the Internet for Web sites, makes copies of the Web pages found, and stores these pages in the search engine's index. A crawler is also known as a spider or Web crawler.
Rating:
Was this information helpful?