web crawler

or web·crawl·er

[ web-kraw-ler ]
/ ˈwɛbˌkrɔ lər /

noun Digital Technology.

(sometimes initial capital letter) a computer program that retrieves data from a website, as in order to index web pages for a search engine.

QUIZZES

Can You Ace This Quiz About “Compliment” vs. “Complement”?
Take this quiz to see if you really know the difference between “compliment” and “complement"!
Question 1 of 11
“Compliment” and “complement” had a shared meaning a long time ago, but today they are no longer interchangeable.
Also called spider.
Compare bot1.

Origin of web crawler

First recorded in 1990–95

OTHER WORDS FROM web crawler

web crawling, noun
Dictionary.com Unabridged Based on the Random House Unabridged Dictionary, © Random House, Inc. 2020