A complete Python scraper to extract product listings and individual product details from Gumtree, including support for pagination and data export to CSV. Optionally, integrate with Crawlbase Smart Proxy to bypass rate limits and IP bans.
π Read the full tutorial β How to Scrape Gumtree Data Easily
- Scrape Gumtree search listings (title, price, location, URL)
- Scrape individual product pages (title, price, description, seller name, image URLs)
- Handle pagination across multiple search result pages
- Export data to CSV files
- Optional integration with Crawlbase Smart Proxy for optimized scraping
Install Python dependencies:
pip install requests beautifulsoup4 pandasFile: gumtree_listings_scraper.py
This script collects product listings from Gumtree's search results and supports multiple pages.
python gumtree_listings_scraper.pyπ Sample output saved as: gumtree_listings.csv
File: gumtree_product_details_scraper.py
Scrape additional product details like description, seller name, and image URLs:
python gumtree_product_details_scraper.pyπ Sample output saved as: gumtree_product_data.csv
To avoid rate limits, CAPTCHA challenges, or IP bans, you can proxy requests through Crawlbase Smart Proxy:
Example:
proxy_url = "http://_USER_TOKEN_@smartproxy.crawlbase.com:8012"
proxies = {"http": proxy_url, "https": proxy_url}
response = requests.get(url, proxies=proxies, verify=False)πͺͺ Replace _USER_TOKEN_ with your Crawlbase token.