Posts by Serhat Kurtulus

View as Markdown

Web Scraping vs API: When to Use Each for Getting Data

Official APIs and web scraping solve the same problem in different ways. Here is how to pick based on coverage, cost, rate limits, and maintenance load.

How to Scrape Trip.com: Hotels, Reviews, and Flight Prices with Python

Scrape Trip.com hotels, reviews, and flight prices with Python. Decode the Next.js RSC stream, call the internal JSON APIs, and export clean CSVs, no browser.

What HTTP 407 "Proxy Authentication Required" Means and How to Fix It in 2026

HTTP 407 Proxy Authentication Required explained: why it never reaches your target, why HTTPS hides the error, and how to fix it in Python, curl, and npm.

ChatGPT Scraping: Send Prompts and Extract Replies Without an API Key

Scrape ChatGPT without an API key. Send prompts to the logged-out app with Python, extract replies, citations, and the search queries ChatGPT actually ran.

How to Scrape Kick.com: Channels, Chat Logs, VODs, and Clips with Python

Scrape Kick.com with Python: channel stats, live streams, chat logs, VODs, and clips as clean CSVs. Bypass Cloudflare with plain requests, no browser.

How to Scrape IKEA: Search, Categories, Prices, and Stock with Python

Scrape IKEA with Python: search, full categories, prices, discounts, and live stock status as clean CSVs from IKEA's internal JSON endpoints. No HTML parsing.

Scraping Etsy Product Data, Categories, and Reviews with Python

Scrape Etsy product pages, reviews, and categories using Python. Step-by-step tutorial with code to bypass DataDome and extract pricing data.

How to Scrape Target.com: Product Data, Prices, and Reviews

Scrape Target.com product data, reviews, and Q&A with Python. Call Redsky and r2d2 JSON APIs directly through Scrape.do, skip HTML rendering, and export to CSV and JSON.

Complete 2026 Amazon Scraping Guide: Product Data, Prices, Sellers, and More

Scrape product details, prices, seller offers, and all color/size variations from Amazon using Python. Includes code for WAF bypass and CSV export.
NEXT PAGE