Configure a Raspberry Pi for web scraping
Conclusion
I successfully scraped 57,000 records in 24 hours, all using a £10 Pi Zero – and was able to leave it running overnight with no fan noise, or heat!
The Pi makes a good choice for using with Scrapy, when you have less than 1 million records/lines in your CSV! 👍