Github Monperrus Crawler User Agents
Repository: crawler-user-agents
Author: monperrus · Source status: Clear source
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders.
Score basis:Clear source · Risk needs review · Universal