About LantadBot

When someone scans a URL with Lantad, our fetcher requests that page identifying itself honestly as LantadBot/1.0 (+https://lantad.co/bot). It never crawls beyond the page it was asked to scan.

Conduct, enforced in code

• At most 20 requests per scan, ever.
• One request at a time per host, at least 500ms apart.
• At most 10 scans of any domain per day, regardless of who asks.
• No crawling: one page per scan, plus robots.txt and llms.txt.
• Artifacts are deleted after 90 days.

User agent probes

A scan sends one request per known AI crawler using that crawler's published user agent string, to detect whether the server treats it differently. These probes exist so site owners can see their own blocking behavior; every probe finding in a report carries the caveat that servers verifying crawler IPs may treat the real crawler differently. The bots we check: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, anthropic-ai, PerplexityBot, Perplexity-User, Google-Extended, Applebot-Extended, Meta-ExternalAgent, Bytespider, CCBot, Amazonbot.

Opt out

Site owners can exclude their domains from scanning entirely. Send a request from an address at the domain in question to [email protected] or POST {"domain": "your-domain.com"} to /api/optout. Once approved, scans of the domain return an opted-out notice instead of fetching anything.