Web crawlerWeb crawler
Rare
Rarity: Rare
A topic known well beyond its field, found in many languages.
Rarity follows how well known the article is: its views on the French and English Wikipedia over a year, and the number of languages it exists in.
At a glance
- Class
- Notion
- Domain
- Science and technology
- In collections
- Nobody has pulled it yet.
What Wikipedia says
A web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web and that is typically operated by search engines for the purpose of Web indexing (web spidering).
Excerpt from the Wikipedia article “Web crawler”, under the CC BY-SA 4.0 license. Read the article on Wikipedia
Image: Internet Archive, Public domain, via Wikimedia Commons.
Open free boosters and add Web crawler to your collection.
Play for free





