logo

UiPath - Scrape.do Integration

View as Markdown

Step-by-step guide to integrate Scrape.do with UiPath Integration Service for bulk web scraping workflows

Scrape.do works in UiPath as an Integration Service connector with one action, Scrape a URL. The ready-made API Workflow reads URLs from Google Sheets, scrapes each one through Scrape.do and writes the HTML back next to it.

Import the connector first, then the workflow. The workflow needs the connector to be present.

1. Import the Connector

  • In UiPath, open Integration Service.
  • Go to Connectors, choose to import a connector from a file and select scrapedo-uipath-connector.zip.
  • Confirm the import. UiPath registers a Scrape.do connector with the Scrape a URL action, a Target URL field and a Render JavaScript toggle.

2. Create Your Scrape.do Connection

  • On the Scrape.do connector, choose Add connection.
  • Paste your API token from your dashboard into the API key field and save.

This is the only place your token is entered, so it never travels inside the shared files.

3. Set Up the Google Sheet

Column A (url)Column B (result)
https://example.com(leave empty)
https://quotes.toscrape.com(leave empty)
  • Put a header in A1 and one target URL per row below it.
  • Clear column B before every run. Old HTML left in B gets mixed into the URL on the next pass and the request fails.

4. Import and Configure the Workflow

  • In Studio Web, import Scrape-Do-Bulk-Workflow.uis and open the Scrape Do Bulk project.
  • Bind the two connections it expects:
    • Google Sheets - Connect your own Google account
    • Scrape.do - Select the connection from step 2
  • In the Read Range and Write Cell activities, select your spreadsheet.

5. Run the Workflow

Run it and column B fills in one row at a time. The workflow reads the sheet with Read Range, skips the header row, calls Scrape a URL for each URL and writes the result with Write Cell.

Render JavaScript is on for every URL. Turn it off for static pages to make requests cheaper and faster.

If you're unable to get a response, visit the playground and experiment with parameters like Super, Render JavaScript, and Block Resources until you get a successful response.

Downloads:

Full tutorial with every step: How to Scrape Any Website in UiPath with Scrape.do (No Proxies, No Code)

On this page