Power BI - Scrape.do Integration
Step-by-step guide to integrate Scrape.do with Power BI to pull live web data into your dashboards
Scrape.do integrates with Power BI through Power Query. A free .pbix template calls the Scrape.do API for every URL in a table, so you paste your URLs, refresh, and the HTML lands in your report with no Python or extensions.
Download the Power BI template (.pbix) to follow along.
1. Add Your API Token
Open the file in Power BI Desktop and click Transform data on the Home ribbon to open the Power Query Editor.
- In the left-hand Queries pane, select the
ScrapeDo_Sniperfunction and click Advanced Editor. - Replace
"ENTER_YOUR_TOKEN_HERE"with your Scrape.do API token from your dashboard and click Done.
2. Load Your Target URLs
- In the Queries pane, click the
Target_URLstable. - In the Query Settings panel on the right, find Applied Steps and click the gear icon next to the
Sourcestep (or double-click it). - Delete the placeholder URLs, paste your own, and click OK.
Power BI sends each URL through Scrape.do and puts the raw HTML in the HTML_Data column.
3. Remove Failed Rows
Right-click the HTML_Data column header and select Remove Errors. This drops dead pages and 5xx errors and leaves only the successfully scraped responses.
If you're unable to get a response, visit the playground and experiment with parameters like Super, Render JavaScript, and Block Resources until you get a successful response.
4. Extract the Fields You Need
The template uses Power Query's Text.BetweenDelimiters function to pull fields out of the HTML. Set the delimiters that surround the data you want:
- Page title:
<title>and</title> - Amazon price:
class="a-price-whole">and<
Click Close & Apply and the extracted columns populate your visuals.
Full tutorial with every step: How to Scrape the Web Directly into Power BI (Free Template)
