Scraping Use Cases Updated
How to Scrape Amazon Reviews (Behind Login Too)
Scrape Amazon reviews with Python: get the 13 featured reviews and the star breakdown of any product in one request, scale to many ASINs, export to CSV.
Author profile
Serhat Kurtulus
Software Engineer
Full-stack software developer with 10+ years of experience. Relatively fresh to web scraping, and sharing my experience as I go on the Scrape.do blog.
Expertise map
What Serhat has written, by topic. Pick a topic to jump to it.
Latest articles
The 6 articles Serhat published or updated most recently.
Scraping Use Cases Published
Scraping Copart in 2026: Extract Salvage Auction Lots, Damage Data, and Bids with Python
Scrape Copart salvage auction lots with Python through the site's own POST search endpoint. Damage codes, title brands, odometer data, and live bids, no browser required.
Scraping Basics Published
Web Scraping vs API: When to Use Each for Getting Data
Official APIs and web scraping solve the same problem in different ways. Here is how to pick based on coverage, cost, rate limits, and maintenance load.
Scraping Use Cases Published
How to Scrape Trip.com: Hotels, Reviews, and Flight Prices with Python
Scrape Trip.com hotels, reviews, and flight prices with Python. Decode the Next.js RSC stream, call the internal JSON APIs, and export clean CSVs, no browser.
Scraping Errors Published
What HTTP 407 "Proxy Authentication Required" Means and How to Fix It in 2026
HTTP 407 Proxy Authentication Required explained: why it never reaches your target, why HTTPS hides the error, and how to fix it in Python, curl, and npm.
Scraping Use Cases Published
ChatGPT Scraping: Send Prompts and Extract Replies Without an API Key
Scrape ChatGPT without an API key. Send prompts to the logged-out app with Python, extract replies, citations, and the search queries ChatGPT actually ran.
01 / 04
Scraping Use Cases
23 articles by Serhat on Scraping Use Cases, newest first.
How to Scrape Amazon Reviews (Behind Login Too)
Scrape Amazon reviews with Python: get the 13 featured reviews and the star breakdown of any product in one request, scale to many ASINs, export to CSV.
Updated
Scraping Copart in 2026: Extract Salvage Auction Lots, Damage Data, and Bids with Python
Scrape Copart salvage auction lots with Python through the site's own POST search endpoint. Damage codes, title brands, odometer data, and live bids, no browser required.
Published
How to Scrape Trip.com: Hotels, Reviews, and Flight Prices with Python
Scrape Trip.com hotels, reviews, and flight prices with Python. Decode the Next.js RSC stream, call the internal JSON APIs, and export clean CSVs, no browser.
Published
ChatGPT Scraping: Send Prompts and Extract Replies Without an API Key
Scrape ChatGPT without an API key. Send prompts to the logged-out app with Python, extract replies, citations, and the search queries ChatGPT actually ran.
Published
How to Scrape Kick.com: Channels, Chat Logs, VODs, and Clips with Python
Scrape Kick.com with Python: channel stats, live streams, chat logs, VODs, and clips as clean CSVs. Bypass Cloudflare with plain requests, no browser.
Updated
How to Scrape IKEA: Search, Categories, Prices, and Stock with Python
Scrape IKEA with Python: search, full categories, prices, discounts, and live stock status as clean CSVs from IKEA's internal JSON endpoints. No HTML parsing.
Updated
Scraping Etsy Product Data, Categories, and Reviews with Python
Scrape Etsy product pages, reviews, and categories using Python. Step-by-step tutorial with code to bypass DataDome and extract pricing data.
Updated
How to Scrape Target.com: Product Data, Prices, and Reviews
Scrape Target.com product data, reviews, and Q&A with Python. Call Redsky and r2d2 JSON APIs directly through Scrape.do, skip HTML rendering, and export to CSV and JSON.
Published
Show 15 more articles on Scraping Use CasesShow fewer
Complete 2026 Amazon Scraping Guide: Product Data, Prices, Sellers, and More
Scrape product details, prices, seller offers, and all color/size variations from Amazon using Python. Includes code for WAF bypass and CSV export.
Updated
Scraping Amazon Search Results, Product Ads, Related Searches
Scrape Amazon search results, sponsored products, and related searches with Python. Extract product listings, competitor ads, and keywords with code examples.
Updated
How to Scrape Amazon Best Sellers with Python
Scrape Amazon Best Sellers with Python. Extract top 100 products, rankings, prices, and ratings from any category with code examples and CSV export.
Updated
How to Scrape Realtor.com: Property Listings, Prices, and Agent Data
Scrape Realtor.com listings with Python. Extract search results rows from embedded JSON, enrich listing data via GraphQL, export CSV and JSON, stay unblocked with Scrape.do.
Published
How to Scrape Yandex: Search Results and Image Search with Python
Scrape Yandex search results and images with Python. Bypass SmartCaptcha with Scrape.do, parse organic listings from HTML, paginate image search via JSON XHR, and export to CSV.
Published
How to Scrape YouTube: Search, Videos, Comments, and Channels
Scrape YouTube search results, video metadata, comments, and channels with Python. Parse ytInitialData and ytInitialPlayerResponse, call InnerTube continuation endpoints, and export clean CSV and JSON.
Published
Scraping Google Maps: Search Results, Reviews, and Place Details Using Python
Scrape Google Maps business listings, place details, and reviews with Python. Extract names, ratings, phone numbers, and review text using protobuf endpoints and Scrape.do.
Updated
Scraping Google Shopping with Python (Search, Products, Sellers, Reviews)
Scrape Google Shopping search results, product details, seller prices, and reviews with Python. Complete working code for async pagination, hidden parameters, and full data export.
Updated
How to Scrape Alibaba Product Listings, Prices, and Reviews
Scrape Alibaba product listings, prices, and reviews with Python. Extract embedded JSON from category and product pages, sign MTOP API requests for reviews, and export structured data to CSV and JSON.
Published
How to Scrape DigiKey: Product Data, Pricing, and Specifications
Scrape DigiKey product data with Python. Handle LZ-String cursor pagination, parse data-testid selectors, and export specs to CSV and JSON.
Published
Scraping Rightmove in 2026: Extract Property Listings and Details with Python
Scrape Rightmove property listings and details with Python. Extract price, address, bedrooms, agent data, and 15+ fields using embedded JSON.
Published
Scraping Wayfair with Python: Products, Categories, and Variations
Scrape Wayfair product details, prices, reviews, and variations with Python. Bypass PerimeterX bot detection using Scrape.do and export structured data.
Published
How to Scrape Screenings and Ticket Prices from cineworld.co.uk
Scrape Cineworld showtimes and ticket prices with Python. Bypass Cloudflare, use UK proxies, extract Vista IDs, and export data to JSON or CSV.
Published
How to Scrape Screenings and Ticket Prices from regmovies.com
Scrape Regal movie showtimes and ticket prices with Python. Bypass Cloudflare, use premium proxies for stable access, and export clean data to JSON or CSV.
Published
2025 Guide to Scraping eBay Listings, Reviews, Search Results, Product Variants
Scrape eBay product data, search results, variants, and reviews using Python requests. Extract valuable insights at scale without getting blocked.
Published
02 / 04
Scraping Basics
2 articles by Serhat on Scraping Basics, newest first.
Web Scraping vs API: When to Use Each for Getting Data
Official APIs and web scraping solve the same problem in different ways. Here is how to pick based on coverage, cost, rate limits, and maintenance load.
Published
Building a Versatile Python Web Crawler from Scratch [2025 guide]
Build a production ready Python web crawler from scratch adding advanced concepts such as concurrency, rate limiting, proxy rotation, robots.txt ethics, and more.
Updated
Also filed under Proxy
04 / 04
Scraping Errors
1 article by Serhat on Scraping Errors, newest first.
What HTTP 407 "Proxy Authentication Required" Means and How to Fix It in 2026
HTTP 407 Proxy Authentication Required explained: why it never reaches your target, why HTTPS hides the error, and how to fix it in Python, curl, and npm.
Published
