#bmpi365
https://read.acloud.guru/how-to-build-a-serverless-web-crawler-7c1c2f37a36 Crawl VS Scrape,前者是递归爬取整站,后者是采集网站特定数据流程,结合AWS Lambda+SQS队列+S3+DynamoDB可以开发出结构灵活的爬虫架构