32 services carry this tag in their source record. Tags come from the provider, not from us — a tag is a claim about what the service does, not proof that it does it well.
Convert a public web page to Markdown or a PNG screenshot, with optional JavaScript rendering. Private addresses refused. Use when an agent must scrape a web page or fetch a URL as clean Markdown instead of raw HTML.
Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live proven...
Does https://<domain>/robots.txt exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of robots.txt tells you about the site's tooling and polici...
Change watch for site has robots txt: runs the check, compares it with the result from your previous call for the same domain (kept 90 days) and returns the current answer, changed true/false, the fields that changed wit...
Signs a timestamped receipt for a file's sha256, proving it existed unchanged then. US$0.002 per call; POST the hash.
robots.txt AI-crawler access matrix: for the 2026 cohort of AI and answer-engine crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot, Google-Extended and more) reports allowed, blocked or...
AI-agent readiness audit, $0.001 USDC per call: How ready is a website for AI agents? Live checks of /llms.txt, robots.txt rules for 12 AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot…), sitemap.xml...
Base or Ethereum contract address -> ABI and function list: Sourcify verification (exact/partial match), contract name, compiler, ABI, function selectors + signatures, event topics; proxies (EIP-1967, ZeppelinOS, others...