Always-on monitoring of how Applebot indexes your site for Apple's billion-device user base. Apple separately controls AI-training inclusion via Applebot-Extended, which does not itself crawl. Sentry catches blocked render resources, missing Extended decisions, and WAF false-positives. Cortex handles the fix.
Continuous audits of Applebot's access to your site against the 10 things that determine whether Siri, Spotlight, and Safari Suggestions can surface you. Applebot-Extended is a separate, meta-only decision and does not itself crawl. Sentry catches both directives plus the Safari-UA WAF trap. Cortex fixes it.
User-agent: Applebot is not Disallowed. This is Apple's search crawler; blocking it removes the site from Siri, Spotlight, and Safari Suggestions across a billion active Apple devices.
robots.txt contains an explicit Allow or Disallow for Applebot-Extended. Apple's docs state this token does NOT crawl — it is a meta-control governing whether content already crawled by Applebot is used for Apple Intelligence foundation-model training.
Recent Applebot visitor IPs match the CIDR prefixes published at search.developer.apple.com/applebot.json, and reverse-DNS lookups resolve appropriately. Filters spoofed Safari-UA imposters.
Canonical content has no `noindex` meta or `X-Robots-Tag: noindex` header. Removes the page from Apple Search inclusion regardless of robots.txt.
Per Apple's published guidance: 'If javascript, CSS, and other resources are blocked via robots.txt, it may not be able to render the content properly.' Render-eligible assets are crawl-allowed.
Critical headings and body copy appear in the initial HTML or are emitted within Apple's render budget. Apple's documentation confirms Applebot 'may render the content of your website within a browser.'
All http:// URLs 301 to https://. The site's declared canonical tag is on the https origin. Apple indexes the https form by default.
Page-level JSON-LD parses cleanly. Apple uses structured data to compose Siri answer cards, Spotlight previews, and rich link previews in Messages.
Apple ships a Safari-shaped UA with an `(Applebot/X.X; +http://www.apple.com/go/applebot)` suffix. WAF rules that flag 'fake Safari' must allowlist the Applebot suffix or recent traffic to the apex domain to avoid blocking the real crawler.
HTML served to Apple's US and EU IP ranges matches the site-wide canonical content. Geo-gated HTML can confuse Apple's region-routed indexing pipeline.
Paste your homepage URL. Sentry verifies robots.txt rules for Applebot and Applebot-Extended, IP-range fidelity against Apple's published CIDR list, render-resource accessibility, JS reachability, and WAF posture toward the Safari-shape UA, then ships a per-rule report. No signup, instant results, always free.
Sentry fetches your site, runs every APPLEBOT rule, and renders the full result page before your next sip of coffee.
Each failed rule ships with a prescription paragraph. Hand it to engineering and the gap is closed before lunch.
Add your site to the daily Sentry sweep with one click. New regressions get caught the next morning.
10 rules in the APPLEBOT Sentry. Daily 3:30 AM ET sweep.
One brain. Thirty-six pairs of eyes. Sentries monitor every visibility signal that decides whether search engines, AI engines, and ad platforms show you. Cortex reads what they see, weighs it against a unified corpus of platform documentation, and acts. Every move follows a defined decision protocol: action stated, reason given, impact named.