Web Page Crawler Revealed 0 ▲ Information Camouflage 1 hour ago · Tech · hide · 0 comments In my post about Scraper Junkyard results, I hypothesized a single, centrally-controlled web crawler that made requests from Contabo GmbH IP address ranges. After a closer look at the Apache combined format log files, I can confirm that at least one web crawler works out of Contabo IP address space. No comments yet. Log in to reply on the Fediverse. Comments will appear here.
