Author profile
Software Engineer
Full-stack software developer with 10+ years of experience. Relatively fresh to web scraping, and sharing my experience as I go on the Scrape.do blog.
What Serhat has written, by topic. Pick a topic to jump to it.
The 6 articles Serhat published or updated most recently.
Scraping Use Cases Updated
Scrape Amazon product details, prices, seller offers and every color or size variation with Python, or get the same data as JSON from the Amazon Scraper API.
Scraping Use Cases Updated
Scrape Google Maps for business leads: name, phone, website and rating in one API call, or build your own Python scraper. Tested code and real output inside.
Scraping Use Cases Updated
Scrape Amazon reviews with Python: get the 13 featured reviews and the star breakdown of any product in one request, scale to many ASINs, export to CSV.
Scraping Use Cases Published
Scrape Copart salvage auction lots with Python through the site's own POST search endpoint. Damage codes, title brands, odometer data, and live bids, no browser required.
Scraping Basics Published
Official APIs and web scraping solve the same problem in different ways. Here is how to pick based on coverage, cost, rate limits, and maintenance load.
Scraping Use Cases Published
Scrape Trip.com hotels, reviews, and flight prices with Python. Decode the Next.js RSC stream, call the internal JSON APIs, and export clean CSVs, no browser.
01 / 04
23 articles by Serhat on Scraping Use Cases, newest first.
Scrape Amazon product details, prices, seller offers and every color or size variation with Python, or get the same data as JSON from the Amazon Scraper API.
Updated
Scrape Google Maps for business leads: name, phone, website and rating in one API call, or build your own Python scraper. Tested code and real output inside.
Updated
Scrape Amazon reviews with Python: get the 13 featured reviews and the star breakdown of any product in one request, scale to many ASINs, export to CSV.
Updated
Scrape Copart salvage auction lots with Python through the site's own POST search endpoint. Damage codes, title brands, odometer data, and live bids, no browser required.
Published
Scrape Trip.com hotels, reviews, and flight prices with Python. Decode the Next.js RSC stream, call the internal JSON APIs, and export clean CSVs, no browser.
Published
Scrape ChatGPT without an API key. Send prompts to the logged-out app with Python, extract replies, citations, and the search queries ChatGPT actually ran.
Published
Scrape Kick.com with Python: channel stats, live streams, chat logs, VODs, and clips as clean CSVs. Bypass Cloudflare with plain requests, no browser.
Updated
Scrape IKEA with Python: search, full categories, prices, discounts, and live stock status as clean CSVs from IKEA's internal JSON endpoints. No HTML parsing.
Updated
Scrape Etsy product pages, reviews, and categories using Python. Step-by-step tutorial with code to bypass DataDome and extract pricing data.
Updated
Scrape Target.com product data, reviews, and Q&A with Python. Call Redsky and r2d2 JSON APIs directly through Scrape.do, skip HTML rendering, and export to CSV and JSON.
Published
Scrape Amazon search results, sponsored products, and related searches with Python. Extract product listings, competitor ads, and keywords with code examples.
Updated
Scrape Amazon Best Sellers with Python. Extract top 100 products, rankings, prices, and ratings from any category with code examples and CSV export.
Updated
Scrape Realtor.com listings with Python. Extract search results rows from embedded JSON, enrich listing data via GraphQL, export CSV and JSON, stay unblocked with Scrape.do.
Published
Scrape Yandex search results and images with Python. Bypass SmartCaptcha with Scrape.do, parse organic listings from HTML, paginate image search via JSON XHR, and export to CSV.
Published
Scrape YouTube search results, video metadata, comments, and channels with Python. Parse ytInitialData and ytInitialPlayerResponse, call InnerTube continuation endpoints, and export clean CSV and JSON.
Published
Scrape Google Shopping search results, product details, seller prices, and reviews with Python. Complete working code for async pagination, hidden parameters, and full data export.
Updated
Scrape Alibaba product listings, prices, and reviews with Python. Extract embedded JSON from category and product pages, sign MTOP API requests for reviews, and export structured data to CSV and JSON.
Published
Scrape DigiKey product data with Python. Handle LZ-String cursor pagination, parse data-testid selectors, and export specs to CSV and JSON.
Published
Scrape Rightmove property listings and details with Python. Extract price, address, bedrooms, agent data, and 15+ fields using embedded JSON.
Published
Scrape Wayfair product details, prices, reviews, and variations with Python. Bypass PerimeterX bot detection using Scrape.do and export structured data.
Published
Scrape Cineworld showtimes and ticket prices with Python. Bypass Cloudflare, use UK proxies, extract Vista IDs, and export data to JSON or CSV.
Published
Scrape Regal movie showtimes and ticket prices with Python. Bypass Cloudflare, use premium proxies for stable access, and export clean data to JSON or CSV.
Published
Scrape eBay product data, search results, variants, and reviews using Python requests. Extract valuable insights at scale without getting blocked.
Published
02 / 04
2 articles by Serhat on Scraping Basics, newest first.
Official APIs and web scraping solve the same problem in different ways. Here is how to pick based on coverage, cost, rate limits, and maintenance load.
Published
Build a production ready Python web crawler from scratch adding advanced concepts such as concurrency, rate limiting, proxy rotation, robots.txt ethics, and more.
Updated
04 / 04
1 article by Serhat on Scraping Errors, newest first.
HTTP 407 Proxy Authentication Required explained: why it never reaches your target, why HTTPS hides the error, and how to fix it in Python, curl, and npm.
Published
