mcpField
C
Crawler For Llm

Crawler For Llm

Local
github.com/KonghaYaoBrowser Automation6Updated 32w ago
Repository

About Crawler For Llm

高等级的免费爬虫MCP, 完全 Markdown 化支持，支持微信公众号等一大批国内网站。A powerful web crawler designed specifically for LLM applications, capable of extracting clean, readable content from various web pages and converting it to Markdown format. This tool is essential for building knowledge bases, training

#web-crawler#markdown-converter#content-extraction#llm-data-preparation#knowledge-base-building#model-context-protocol-mcp

Configuration

Local server config is the same for every client. Copy it into your client’s MCP config file.

mcp.json · Universal config
{
  "mcpServers": {
    "langgraph-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "@langgraph-js/crawler-mcp"
      ]
    }
  }
}
Run commandnpx -y @langgraph-js/crawler-mcp

Local servers need a runtime on your machine (e.g. Node.js 18+). Config file locations differ by client; see your client’s docs.

Packages
npm@langgraph-js/crawler-mcp

Tools

2

Saved tool list · updated 2w ago

ParameterTypeRequiredDescription
rawbooleanNoreturn raw html
urlstringYesthe url to crawl

Details

The maintainer has not added details yet. Check the README in the repository.

Comments

Markdown supported

New to MCP?

From what the protocol is to installing your first server, these answers cover most first questions.

An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.