#web_cpc
https://github.com/NikolaiT/Crawling-Infrastructure Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues. https://scrapeulous.com/