Dictionary.com

web crawler

or web·crawl·er

[ web-kraw-ler ]
/ ˈwɛbˌkrɔ lər /
Save This Word!

noun Digital Technology.
a computer program that digitally surveys websites, as in order to index web pages for a search engine.
QUIZ
QUIZ YOURSELF ON AFFECT VS. EFFECT!
In effect, this quiz will prove whether or not you have the skills to know the difference between “affect” and “effect.”
Question 1 of 7
The rainy weather could not ________ my elated spirits on my graduation day.
Meet Grammar CoachWrite or paste your essay, email, or story into Grammar Coach and get grammar helpImprove Your Writing
Meet Grammar CoachImprove Your Writing
Write or paste your essay, email, or story into Grammar Coach and get grammar help
Sometimes Web crawl·er .
Also called crawl·er .
Compare bot1, spider.

Origin of web crawler

First recorded in 1990–95

OTHER WORDS FROM web crawler

web crawling, noun
Dictionary.com Unabridged Based on the Random House Unabridged Dictionary, © Random House, Inc. 2022

How to use web crawler in a sentence

FEEDBACK