Skip to content

// definition

Crawl

Automated retrieval of web content

Digital economy & data

Short definition

An automated request through which a crawler retrieves a web resource for processing or storage. Server access and later uses of a stored copy are different events. Under Pay Per Crawl, a successful paid retrieval is billed according to the service’s terms.

risk atlas

Knowledge map