Lantad blog https://lantad.co/blog Findings from real AI crawler scans, guides, and product notes on generative engine optimization. en A user agent is a claim, not an identity https://lantad.co/blog/a-user-agent-is-a-claim-not-an-identity https://lantad.co/blog/a-user-agent-is-a-claim-not-an-identity Tue, 28 Jul 2026 09:00:00 GMT Guides Every per-crawler number you have ever seen, including ours, counts requests that said they were a crawler. Verifying the claim needs an IP check, and most tools do not do one. The AI preferences standard you cannot deploy yet https://lantad.co/blog/the-ai-preferences-standard-you-cannot-deploy-yet https://lantad.co/blog/the-ai-preferences-standard-you-cannot-deploy-yet Tue, 28 Jul 2026 09:00:00 GMT Guides The IETF vocabulary for expressing AI usage preferences reached its sixth draft on 28 April 2026. The companion draft that defines where to write one down expired on 1 May 2026, so there is still nothing on your site for a crawler to read. Three AI crawler tokens that will never appear in your logs https://lantad.co/blog/the-crawler-tokens-that-never-appear-in-your-logs https://lantad.co/blog/the-crawler-tokens-that-never-appear-in-your-logs Tue, 28 Jul 2026 09:00:00 GMT Guides Google-Extended, Applebot-Extended and anthropic-ai are robots.txt product tokens that send no user agent of their own, so a log search for them returns zero forever, and that zero does not mean what it looks like. Two layers decide whether AI can read your site, and robots.txt is the weaker one https://lantad.co/blog/two-layers-decide-if-ai-can-read-your-site https://lantad.co/blog/two-layers-decide-if-ai-can-read-your-site Tue, 28 Jul 2026 09:00:00 GMT Guides Cloudflare said on 1 July 2026 that from 15 September newly onboarded domains will block Training and Agent bots by default on pages that display ads. Your robots.txt will not mention it, because robots.txt was never the layer that answers. What the evidence actually says about llms.txt https://lantad.co/blog/what-the-evidence-says-about-llms-txt https://lantad.co/blog/what-the-evidence-says-about-llms-txt Tue, 28 Jul 2026 09:00:00 GMT Findings Ahrefs measured 137,210 domains in May 2026 and found 97 percent of valid llms.txt files were never fetched at all. We ship an llms.txt tool, and we think you should know this. Five structural signals that tell an AI who you are https://lantad.co/blog/five-signals-that-tell-ai-who-you-are https://lantad.co/blog/five-signals-that-tell-ai-who-you-are Sun, 26 Jul 2026 09:00:00 GMT Guides We re-measured the five structured-data signals behind Entity Confidence against 30 pages fetched in one day, removed two of them, and added two nobody was checking. What a crawler actually meets on a real storefront https://lantad.co/blog/what-a-crawler-meets-on-a-real-storefront https://lantad.co/blog/what-a-crawler-meets-on-a-real-storefront Sat, 25 Jul 2026 09:00:00 GMT Findings Six real captures, measured on one day in July. Two stores on the same platform produced opposite outcomes, and the difference was not their content. Why we will not grade a page we could not measure https://lantad.co/blog/why-we-withhold-a-grade https://lantad.co/blog/why-we-withhold-a-grade Sat, 25 Jul 2026 09:00:00 GMT Product Every AI visibility tool prints a number. When the measurement failed, that number is a guess wearing a lab coat, so ours refuses to appear.