← All skills

Generic Scrapers

Your agent's plain fetches get blocked or summarized away; this returns the real page as structured data.

Web & Search

Reads and extracts content from web pages you already have a URL for. Give it a URL and get back clean text, a JSON object of specific fields, a list of all pages on the site, or rendered output from pages that need JavaScript or interaction. Use this when you know the page you want; use Web Search when you need to find pages first.

Use when

You have a URL (or a site, or a search query) and need the real page content, specific fields off it, or what a search engine ranks, not a model guess.

Not for

Platform-specific scrapers like LinkedIn, Amazon, or maps reviews (use Site Scrapers), open-web research to find URLs first (use Web Search), pages behind a personal login, or browser-automation scripting.

What you can do

Each is a sub-skill of Generic Scrapers; the router picks the right one for your request.

What you get back

information

Returns page content as Markdown, an extracted JSON object, a list of URLs, or parsed search results, depending on the job.

When it checks with you first

The request gives a URL but it is unclear whether you want the page read, specific fields extracted, or the whole site's URLs listed.

Run it

Skills run through one gateway with your Faro token. Hand it an intent in plain language; Faro routes to the right sub-skill, runs it, and bills per call.

curl -X POST "https://skill.askfaro.com/skills/web-scraping/run" \
  -H "Authorization: Bearer $FARO_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"intent":{"prompt":"Get all the text from this article"}}'

Example requests

  • Get all the text from this article
  • Scrape the product name, price, and rating from this page
  • Click the "Load more" button and get the additional results
  • List all the URLs on this documentation site