The Cannabis Data-Driven System is intended to deliver a ton of data from 3000 websites in the US and Canada.
The system must generate 2 daily CSV data sets– the products dataset is one of them, and the producer dataset is another. Using scrapers, the system gathers data from well-known cannabis websites like: https://dutchie.com and https://www.iheartjane.com/.
The scrapers are set up on 4 servers and run automatically every day– to avoid the anti-scraping bots; they use brightdata proxy. The servers’ storage for the data is contained in a designated folder.
The analysis module then extracts the crucial data from the dumped CSV files. The dashboard displays the data after analysis. Users can control and keep an eye on the cannabis data analysis with the help of the dashboard.
Project Details
- Category: Cannabis Industry
- Client: Michael
- Location: Canada
- Manager Wilson Chan
- Year Completed 2021
- Project Value 70k