26 services carry this tag in their source record. Tags come from the provider, not from us — a tag is a claim about what the service does, not proof that it does it well.
Email deliverability & domain security check — validates SPF, DKIM (multi-selector), and DMARC, detects spoofing and misconfigurations, and returns an A–F email security grade with transparent deductions. Anti-spam / ant...
Where is this competitor vulnerable? Finds exploitable gaps in a competitor's marketing presence across content, channels and positioning, then returns quick wins and a six-month attack plan for a given competitor and in...
Audits a website for AI agent and AI crawler readiness from caller-supplied inputs: robots.txt, HTML, headers, llms.txt, sitemap lastmod, /.well-known. Names the policy per AI token (GPTBot, OAI-SearchBot, ChatGPT-User,...
Cheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is no...
Domain in, a grade from A to F out: how readable a website is to AI crawlers and answer engines (robots.txt, llms.txt, sitemap, JSON-LD, MCP and x402 readiness). Public files only, no LLM. $0.05 USDC per request.
Check if a URL is up: status, latency, redirects, title.
Robots.txt Policy Writer — Turns a crawler policy written in words into a correct robots.txt, answered as the file only. Knows the mistakes that make a file do the opposite of what was meant - a crawler obeys only the on...
CUDA, driver and Ollama compatibility - GPU support, model memory fit and proof inference uses the GPU
Lints and validates a caller-supplied robots.txt against RFC 9309 and reports every check, not only the failures: group structure, product token charset, path patterns, special characters, other records, size limit. Give...
Site snapshot (SEO + security + tech + email): All four quick checks in one call for a website: on-page SEO score and issues, security headers/TLS grade, tech stack, and the domain's SPF/DKIM/DMARC email authentication....
Given a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extend...
Use when an agent is about to crawl, train on or ingest a website into RAG: checks the domain's AI consent and licensing signals (robots.txt per AI bot, RSL license, IETF AIPREF, TDMRep, noai meta tags, llms.txt, C2PA),...
Health and payment-path check. Returns server time and confirms the x402 payment settled. The cheapest endpoint in the catalog at $0.001, intended for testing a client's payment flow.
Look up the company behind a domain: name, description, category, location, socials, mail/DNS/hosting providers and registration, each with source and confidence.
Robots.txt check. Read a site's robots.txt and say whether a crawler may fetch a URL, by RFC 9309 rules as Google applies them (most specific user-agent group, longest matching Allow or Disallow, Allow on ties, * and $ w...
robots.txt parser: rules, sitemaps, AI-crawler blocks, and is-this-path-allowed check — Genesis402 / UnyKorn Operator Network
Can I fetch this URL? robots.txt + AI-crawler permission gate: Pre-fetch gate for agents and scrapers: is this exact URL allowed by robots.txt (RFC 9309: missing = allow, 5xx/unreachable = disallow) for generic agents an...
Resolve ENS (.eth) on Ethereum and Basenames (.base.eth) on Base, forward or reverse. Returns address, name, source, forward_verified, optional avatar.
Convert one bounded fiat amount using the latest successfully fetched European Central Bank daily foreign-exchange reference table. Forest returns the ECB observation date and deterministic cross-rates through EUR. Fresh...
Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live proven...
Does https://<domain>/robots.txt exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of robots.txt tells you about the site's tooling and polici...
Change watch for site has robots txt: runs the check, compares it with the result from your previous call for the same domain (kept 90 days) and returns the current answer, changed true/false, the fields that changed wit...
Signs a timestamped receipt for a file's sha256, proving it existed unchanged then. US$0.002 per call; POST the hash.
robots.txt AI-crawler access matrix: for the 2026 cohort of AI and answer-engine crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot, Google-Extended and more) reports allowed, blocked or...