14 services carry this tag in their source record. Tags come from the provider, not from us — a tag is a claim about what the service does, not proof that it does it well.
Web scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns em...
Quick review: does an AI crawler (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot) actually see your site? Every rule, no model: $0.1 for one check. Returns the score, findings by severity and the five that matter most (...
CUDA, driver and Ollama compatibility - GPU support, model memory fit and proof inference uses the GPU
AI crawler visibility audit: is your website visible to AI crawlers (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot) so ChatGPT, Claude and Perplexity can read and cite it? Fetched like an AI crawler, without JavaScript...
Catalog snapshot: every site in the 402registry catalog of sites verified visible to AI crawlers, as one JSON file rendered at purchase, every record dated. Basic fields are free at https://402registry.com/registry.json;...
Drop-in Firecrawl-compatible scrape: send {url, formats: [markdown, links, rawHtml]} as for Firecrawl v1 /scrape and get {success, data: {markdown, links, rawHtml, metadata: {title, description, language, sourceURL, stat...
Robots.txt check. Read a site's robots.txt and say whether a crawler may fetch a URL, by RFC 9309 rules as Google applies them (most specific user-agent group, longest matching Allow or Disallow, Allow on ties, * and $ w...
Parse a site's robots.txt: whether a user-agent may crawl a path, which AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, CCBot...) are blocked, and declared sitemaps. Check before your agent scrapes.
Every link on a web page with its anchor text, split into internal and external, with nofollow flags and the most-linked external domains. Use for SEO audits, crawling, backlink research or broken-link checks.
Convert one bounded fiat amount using the latest successfully fetched European Central Bank daily foreign-exchange reference table. Forest returns the ECB observation date and deterministic cross-rates through EUR. Fresh...
Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live proven...
Sitemap reader: every URL a website publishes, from robots.txt and its sitemaps, with last-modified dates. Every URL a website publishes, from its own sitemaps: pass ?url= and we read robots.txt for Sitemap: lines (else...
Multi-page site audit: crawls up to 6 pages of a domain (homepage plus the most-linked pages), checks titles, meta descriptions, h1s, image alts, canonicals, viewport, response times and sitemap/robots presence, then ret...
Instant 30-Day Prepaid API Key Pass (ak_live_...) for AI agents, LangChain, n8n, Make.com, and developers. Unlocks all 23 paid per-call Agent Kiosk REST & MCP intelligence tools for 30 days via X-API-KEY header without p...