mcpField
M
MCP Web Extractor

MCP Web Extractor

Local
github.com/iemongBrowser Automation0Updated 82w ago
Repository

About MCP Web Extractor

MCP Web Extractor is an MCP server for extracting readable article content from web pages. It uses Readability.js to remove distractions and return text with metadata, including details useful for saving articles to Obsidian.

Key features

  1. 01Extract main content from a URL
  2. 02Remove ads and sidebars
  3. 03Return clean text and metadata
  4. 04Example integration for Obsidian

Use cases

  1. 01Create readable article notes
  2. 02Extract page text for research
  3. 03Build an Obsidian content workflow

MCP support

Exposes an `extract-content` capability that accepts a URL and returns title, content, text, excerpt, and site name.

#mcp#web-extractor#readability

Configuration

Local server config is the same for every client. Copy it into your client’s MCP config file.

No install method listed yet

We haven’t collected a package or remote endpoint for this server. Follow the instructions in the project README.

Repository

Tools

No tool list yet

Local servers expose tools only once running on your machine, and the maintainer has not provided a tool list.

Details

From the project README

MCP Web Extractor

A Model Context Protocol (MCP) server that extracts web content using Readability.js. This tool fetches web pages and extracts the main content, making it ideal for saving clean, readable versions of articles to Obsidian notes.

Features

  • Extracts readable content from any URL
  • Removes ads, sidebars, and other distractions
  • Returns clean text along with metadata (title, excerpt, etc.)
  • Easy integration with Obsidian via MCP

Installation

# Clone the repository
git clone https://github.com/iemong/mcp-web-extractor.git
cd mcp-web-extractor

# Install dependencies
npm install

# Build the project
npm run build

# Start the server
npm start

The server will start on http://localhost:3000 with the MCP endpoint at http://localhost:3000/mcp.

Usage

As a standalone service

You can use the included client example to extract content from a URL:

ts-node-esm client-example.ts
With Obsidian

The obsidian-integration.ts file provides an example of how to integrate this MCP server with Obsidian. You can use it as a starting point for creating an Obsidian plugin that extracts web content.

API

The MCP server provides the following capability:

  • extract-content: Extracts readable content from a given URL
    • Parameters: { url: string }
    • Returns: { title, content, textContent, excerpt, siteName }

License

MIT

Comments

Markdown supported

New to MCP?

From what the protocol is to installing your first server, these answers cover most first questions.

An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.