Dictionary.com

web crawler

or web·crawl·er

[ web-kraw-ler ]
/ ˈwɛbˌkrɔ lər /
Save This Word!

noun Digital Technology.
a computer program that digitally surveys websites, as in order to index web pages for a search engine.
QUIZ
QUIZ YOURSELF ON "WAS" VS. "WERE"!
Were you ready for a quiz on this topic? Well, here it is! See how well you can differentiate between the uses of "was" vs. "were" in this quiz.
Question 1 of 7
“Was” is used for the indicative past tense of “to be,” and “were” is only used for the subjunctive past tense.
Sometimes Web crawl·er .
Also called crawl·er .
Compare bot1, spider.

Origin of web crawler

First recorded in 1990–95

OTHER WORDS FROM web crawler

web crawling, noun
Dictionary.com Unabridged Based on the Random House Unabridged Dictionary, © Random House, Inc. 2022

How to use web crawler in a sentence

FEEDBACK