> ## Documentation Index
> Fetch the complete documentation index at: https://docs.asksightline.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Site health and site map

> Whether AI can read your pages, and how easy they are to quote and cite.

AI can only recommend what it can read. Site health checks whether AI bots can reach your pages and how easy those pages are to quote. The site audit runs weekly.

## AI readiness score

Each page gets a score from 0 to 100 based on:

* Text in the server-rendered HTML (not only added by JavaScript)
* Title and description
* Headings
* Structured data
* FAQ content
* Freshness
* Speed

> [!WARNING]
>
> A score under 70 means something is holding the page back. Open the page to see exactly which checks fail.

## robots.txt and AI bots

Site health also shows which AI bots your `robots.txt` lets in. There are three kinds:

| Bot type | What it does | Should you block it? |
| - | - | - |
| **Retrieval** | Fetches pages live to answer someone's question, like ChatGPT-User or Perplexity-User | No. Blocking keeps you out of answers. |
| **Indexing** | Builds a search index that AI answers draw on | No, for the same reason. |
| **Training** | Collects pages to train future models, like GPTBot | Your choice. It doesn't affect answers today. |

Fix blocked retrieval bots first, then the lowest-scoring pages.

## Site map

The Site map shows every page on your site as a tree, built from your `sitemap.xml` (or your homepage's links if there isn't one), plus any page AI cites, bots visit or people land on from AI. It's re-mapped weekly.

For each page you can see its AI readiness score, AI bot visits, citations and AI referrals. Sort or search to find the best and worst pages. A page's detail view shows:

* Citations by platform and question
* Questions it was read for but not cited
* Bot activity and robots.txt access
* Its readiness checks, with a button to re-check
* A Google index check
* An optimizer that suggests the page's intent, audience, questions to win and changes to make

> [!TIP]
>
> Start with important pages that score low, and pages AI reads but never cites.

Bot visit data needs [agent traffic](https://docs.asksightline.com/integrations/wordpress-plugin.md), and AI referral data needs [Google Analytics](https://docs.asksightline.com/integrations/google-analytics.md). Both are on the Growth plan.


## Related topics

- [WordPress plugin](https://docs.asksightline.com/integrations/wordpress-plugin.md)
- [Sources](https://docs.asksightline.com/dashboard/sources.md)
- [Questions](https://docs.asksightline.com/dashboard/questions.md)
- [WordPress publishing](https://docs.asksightline.com/action/wordpress-publishing.md)
- [Claude Code and Cursor handoffs](https://docs.asksightline.com/action/coding-agents.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.