About MCP LLMS.txt Explorer
MCP LLMS.txt Explorer is an MCP server for checking websites that publish llms.txt or llms-full.txt files and analyzing their contents. It is intended for developers who want to find out which sites follow the llms.txt standard.
Key features
- 01Check a website for llms.txt files
- 02Check a website for llms-full.txt files
- 03Parse and validate llms.txt file contents
- 04List known websites filtered by file type
Use cases
- 01Checking whether a domain implements the llms.txt standard
- 02Listing known sites that publish llms.txt from an MCP client
MCP support
This project is an MCP server that provides llms.txt checking and listing functions through tools such as check_website and list_websites.
Configuration
Local server config is the same for every client. Copy it into your client’s MCP config file.
Tools
Local servers expose tools only once running on your machine, and the maintainer has not provided a tool list.
Details
From the project READMEMCP LLMS.txt Explorer
A Model Context Protocol server for exploring websites with llms.txt files. This server helps you discover and analyze websites that implement the llms.txt standard.
Features
Resources
- Check websites for llms.txt and llms-full.txt files
- Parse and validate llms.txt file contents
- Access structured data about compliant websites
Tools
check_website- Check if a website has llms.txt files- Takes domain URL as input
- Returns file locations and validation status
list_websites- List known websites with llms.txt files- Returns structured data about compliant websites
- Supports filtering by file type (llms.txt/llms-full.txt)
Development
Install dependencies:
pnpm install
Build the server:
pnpm run build
For development with auto-rebuild:
pnpm run watch
Installation
Installing via Smithery
To install mcp-llms-txt-explorer for Claude Desktop automatically via Smithery:
npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude
Installing Manually
To use this server:
# Clone the repository
git clone https://github.com/thedaviddias/mcp-llms-txt-explorer.git
cd mcp-llms-txt-explorer
# Install dependencies
pnpm install
# Build the server
pnpm run build
Configuration with Claude Desktop
To use with Claude Desktop, add the server config:
On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json
On Windows: %APPDATA%/Claude/claude_desktop_config.json
{
"mcpServers": {
"llms-txt-explorer": {
"command": "node",
"args": ["/path/to/llms-txt-explorer/build/index.js"]
}
}
}
For npx usage, you can use:
{
"mcpServers": {
"llms-txt-explorer": {
"command": "npx",
"args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"]
}
}
}
Debugging
Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:
pnpm run inspector
The Inspector will provide a URL to access debugging tools in your browser.
License
This project is licensed under the MIT License—see the LICENSE file for details.
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.