mcpField
A
aeo-mcp

aeo-mcp

Local
github.com/arthurcarlsonnBusiness & Marketing0Updated 17w ago
Repository

About aeo-mcp

aeo-mcp is a read-only server for agents that need to assess how websites appear to AI answer engines. It checks crawler rules, llms.txt, structured data, page signals, and a 29-check AI-readiness audit without API keys.

Key features

  1. 01Run a 29-check AI-readiness audit
  2. 02Check AI crawler rules and sitemaps
  3. 03Inspect llms.txt structure and validity
  4. 04Extract structured data from pages
  5. 05Review on-page signals

Use cases

  1. 01Find issues affecting AI-answer visibility
  2. 02Compare AI crawler access across websites
  3. 03Check whether llms.txt is valid
  4. 04Review page metadata and schema markup

MCP support

Exposes read-only website inspection and audit tools to MCP clients, including Claude, Claude Code, and Cursor.

Configuration

Local server config is the same for every client. Copy it into your client’s MCP config file.

mcp.json · Universal config
{
  "mcpServers": {
    "arthurcarlsonn-aeo": {
      "command": "npx",
      "args": [
        "-y",
        "aeo-mcp"
      ]
    }
  }
}
Run commandnpx -y aeo-mcp

Local servers need a runtime on your machine (e.g. Node.js 18+). Config file locations differ by client; see your client’s docs.

Packages
npmaeo-mcp1.0.1

Tools

5

Saved tool list · updated 2w ago

ParameterTypeRequiredDescription
urlstringYesWebsite URL to audit, e.g. https://example.com

Details

From the project README

aeo-mcp

An MCP server that gives AI agents — Claude, Claude Code, Cursor, anything speaking the Model Context Protocol — tools to inspect a website's visibility to AI answer engines. Crawler permissions, llms.txt, structured data, on-page signals, and a full 29-check AI-readiness audit (powered by answer-audit), each one tool call away. Read-only, no API keys, no telemetry.

Claude Desktop using aeo-mcp to inspect The Verge's AI crawler policy

Real session: Claude Desktop discovers The Verge allows GPTBot (OpenAI licensing deal) while blocking ClaudeBot, PerplexityBot, Google-Extended, and CCBot — one tool call.

Install

Claude Code

claude mcp add aeo -- npx -y aeo-mcp

Claude Desktop (claude_desktop_config.json)

{ "mcpServers": { "aeo": { "command": "npx", "args": ["-y", "aeo-mcp"] } } }

Cursor (.cursor/mcp.json)

{ "mcpServers": { "aeo": { "command": "npx", "args": ["-y", "aeo-mcp"] } } }

Tools

ToolWhen the agent uses itInputReturns
audit_url"How visible is this site to ChatGPT/Perplexity?" — full AEO health check{ url }0-100 score, grade, category breakdown, failed/warned checks with fixes
check_ai_crawlers"Is GPTBot blocked?" — robots.txt policy per AI bot{ url }Per-bot allow/block verdicts with the matching rule, plus sitemaps
inspect_llms_txt"Does this site have llms.txt? Is it valid?"{ url }Title, summary, sections with links, structural issues, raw excerpt
extract_structured_data"What schema markup does this page have?"{ url }JSON-LD types, key fields per node, parse errors
extract_page_signals"Why do engines misread this page?"{ url }Title, meta description, h1, canonical, lang, text ratio, heading outline, client-side-rendering flag

Bots checked by check_ai_crawlers: GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bingbot.

Try these prompts

  • "Audit glowlab.com and summarize the top 3 AEO fixes."
  • "Compare the AI crawler policies of nike.com and adidas.com — who is more open to being cited?"
  • "Check if my site has a valid llms.txt, and if not, draft one from my page signals."

Security

The server fetches model-supplied URLs, so it ships with an SSRF guard: http/https only, DNS resolution checked against private and special ranges (loopback, RFC1918, link-local, unique-local, IPv4-mapped forms), re-validation on every redirect hop, 10 s timeout, 2 MB body cap, max 5 redirects. Violations return a clean tool error, never an exception. All tools are read-only and no LLM calls happen inside the server.

Development

npm install
npm run build   # required before npm test (the protocol test runs dist/)
npm test

Tests include a scripted stdio round-trip (initialize → tools/list → tools/call) against the built server. To inspect interactively:

npx @modelcontextprotocol/inspector node dist/index.js

License

MIT © Arthur Carlson

Comments

Markdown supported

New to MCP?

From what the protocol is to installing your first server, these answers cover most first questions.

An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.