Skip to content

ScraperHub/gumtree-scrapers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

crawling-api-cta

πŸ›’ Scrape Gumtree Data Easily with Python

A complete Python scraper to extract product listings and individual product details from Gumtree, including support for pagination and data export to CSV. Optionally, integrate with Crawlbase Smart Proxy to bypass rate limits and IP bans.

πŸ“– Read the full tutorial β†’ How to Scrape Gumtree Data Easily

πŸ“Œ Features

  • Scrape Gumtree search listings (title, price, location, URL)
  • Scrape individual product pages (title, price, description, seller name, image URLs)
  • Handle pagination across multiple search result pages
  • Export data to CSV files
  • Optional integration with Crawlbase Smart Proxy for optimized scraping

🧰 Requirements

Install Python dependencies:

pip install requests beautifulsoup4 pandas

πŸ” Gumtree Listings Scraper

File: gumtree_listings_scraper.py

This script collects product listings from Gumtree's search results and supports multiple pages.

python gumtree_listings_scraper.py

πŸ“„ Sample output saved as: gumtree_listings.csv

πŸ“¦ Gumtree Product Details Page Scraper

File: gumtree_product_details_scraper.py

Scrape additional product details like description, seller name, and image URLs:

python gumtree_product_details_scraper.py

πŸ“„ Sample output saved as: gumtree_product_data.csv

⚑️ Boost with Crawlbase Smart Proxy (Optional)

To avoid rate limits, CAPTCHA challenges, or IP bans, you can proxy requests through Crawlbase Smart Proxy:

Example:

proxy_url = "http://_USER_TOKEN_@smartproxy.crawlbase.com:8012"
proxies = {"http": proxy_url, "https": proxy_url}

response = requests.get(url, proxies=proxies, verify=False)

πŸͺͺ Replace _USER_TOKEN_ with your Crawlbase token.

About

Gumtree.com Search Listings and Product Details Pages Scrapers. Listing Scraper effectively handle pagination.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages