Public AI visibility report
apnews.com
Measured facts
| AI readability score | 61.1/100 (grade C) |
|---|---|
| Prose parity, crawler against browser | 91% |
| Retrievability | 91% |
| Crawler access | 0% |
| Structure | 77% |
| Structured data | 40% |
| Page title | pass |
| Meta description | pass |
| Exactly one H1 | fail |
| Canonical link | pass |
| Heading coverage | pass |
| No wall of text | pass |
| llms.txt | fail |
| Words an AI crawler received | 5,543 |
| Words a browser rendered | 6,012 |
| Named AI crawlers allowed by robots.txt | 6 of 15 |
| Schema types in the crawler's HTML | WebSite, NewsMediaOrganization |
| Redirects before the page | 0 |
What the scan found on apnews.com
- An AI crawler requesting apnews.com received 5,543 words of main text, against 6,012 in a browser, a prose parity of 91%.
- robots.txt blocks AI search crawlers. Claude-SearchBot: Disallow: /; PerplexityBot: Disallow: /
- robots.txt blocks AI assistant user agents. Claude-User: Disallow: /
- Server-level blocking of AI crawler user agents. ClaudeBot got HTTP 402; Claude-SearchBot got HTTP 402; Claude-User got HTTP 402; PerplexityBot got HTTP 402; Perplexity-User got HTTP 402; Meta-ExternalAgent got HTTP 402; Bytespider got HTTP 402; CCBot got HTTP 402. Servers that verify crawler IPs will block a spoofed user agent from any scanner; the real crawler may pass.
- Page does not have exactly one H1. Found 0 H1 elements in the initial HTML.
- No llms.txt. No llms.txt at the site root.
- Structured data uses no recognized business type. types found: WebSite, NewsMediaOrganization
- robots.txt on apnews.com blocks GPTBot, ClaudeBot, Claude-SearchBot, Claude-User, anthropic-ai, PerplexityBot, Applebot-Extended, CCBot, Amazonbot.
- The homepage HTML is missing or failing: exactly one h1, llms.txt.
- Structured data in the crawler's HTML: WebSite, NewsMediaOrganization.
Top 3 issues
- robots.txt blocks AI search crawlers. Allow the AI search crawlers you want citations from (they fetch to answer user queries, not to train).
- robots.txt blocks AI assistant user agents. Assistant user agents fetch on behalf of a human asking about you; blocking them removes you from those answers.
- Server-level blocking of AI crawler user agents. Requests with AI crawler user agents get blocked at the edge. Review CDN/WAF bot rules if you want AI visibility.
How to fix them: the fix guides by platform , or the full report with the evidence.
Scan again
Changed something? A new scan takes about a minute and updates this page.
Scan apnews.com againThis homepage is 18.9 points short of the 80 that unlocks a score badge. Do this first lists the quickest fixes; scan again once they are live.
Is this your site?
You can have this page removed, or ask for a correction, by proving you control apnews.com with a DNS record or an email at the domain. A verified removal takes effect immediately; corrections are reviewed within 2 business days. Remove or correct this page.
Pages are listed for search only when the scan is graded, carries at least 8 measured facts and 150 words of findings about this domain, and is under 90 days old. How the scan works.