Python script for scraping the data of netmeds.com
- Base url https://www.netmeds.com/ is used for scraping the data.
- Functionality of category wise scraping.
- Multiple pages can be fetched as well.
- Scraped data can be stored in .csv file
- Tested script by scraping 10 pages of each category (examples inside the CSVs folder).
- Product name
- Drug varient
- Product photo url
- Product url
- Final price
- Original price
- Offer
- is_in_stock
- beautifulsoup4 (v4.9.3)
- requests (v2.25.1)
- numpy (v1.20.2)
- pandas (v1.2.3)
- os
for ubuntu write
python3 scrapmads.py
for windows
python scrapmads.py
after running the code you will be able to see the list of categories. now you have to select one categories and no of pages to fetch. after fetching the data will be store in respective .csv files. To exit the program write break.