11 services carry this tag in their source record. Tags come from the provider, not from us — a tag is a claim about what the service does, not proof that it does it well.
Discover a website's URLs in one call: reads robots.txt, its declared sitemap(s) (sitemap indexes and gzipped sitemaps included, /sitemap.xml as the fallback) and the start page's internal links, then returns a same-host...
List the URLs of a website without reading them: robots.txt, sitemaps and sitemap indexes plus homepage links, up to 1,000 same-site URLs with lastmod and source. A cheap first step to decide which pages to read with web...
Fetch and parse a sitemap.xml (or sitemap index): returns up to 500 URLs with lastmod, or the child sitemaps of an index.
List the URLs of a site's XML sitemap (found via robots.txt if needed, following sitemap indexes and .gz files) with last-modified dates, optionally filtered by text. Discover a site's pages for crawling or monitoring.
Pull emails, URLs, IPv4s, @mentions, and #hashtags out of free text. Returns deduped lists.
Breached password check: is this password in known data breaches, and how often? Send only the SHA-1 hash (never the password); just the first 5 characters reach Have I Been Pwned (k-anonymity). Up to 50 hashes per call.
Extract HTTP/HTTPS URLs from text for $0.001 USDC. Call when you need this bounded result without an API key or subscription. Returns machine-readable JSON via x402 on Base or Solana. Limitation: results cover only the s...
Extract urls from a web page: fetches the URL and returns every urls found in the page text and markup (deduplicated, with counts and up to 300 items), so an agent gets the values without parsing HTML. $0.01 per page.
Bulk extract urls from page: up to 20 urls in one call, processed concurrently, results in input order with a per-item error field and a failure count. Same answer per item as the single endpoint. Batch enrichment for ag...
Change watch for extract urls from page: runs the check, compares it with the result from your previous call for the same url (kept 90 days) and returns the current answer, changed true/false, the fields that changed wit...
Sitemap URL list: fetches sitemap.xml (or the URL you give), expands sitemap indexes up to two levels, and returns the page URLs (up to 500 shown), total count, sitemaps visited and lastmod range. Crawl planning and site...