mcpField
U
UseScraper MCP Server

UseScraper MCP Server

Local
github.com/tanevanwifferenBrowser Automation4Updated 87w ago
Repository

About UseScraper MCP Server

UseScraper MCP Server is a TypeScript server that uses the UseScraper API to retrieve webpage content. Its `scrape` tool supports text, HTML, Markdown, proxy options, and structured extraction.

Key features

  1. 01Scrape webpage content by URL
  2. 02Output text, HTML, or Markdown
  3. 03Optional advanced proxy
  4. 04Optional structured data extraction

Use cases

  1. 01Extracting page content for an MCP client
  2. 02Retrieving webpages in Markdown or HTML
  3. 03Scraping pages with an advanced proxy

MCP support

It exposes a `scrape` tool to MCP clients, accepting a URL and options for output format, proxy use, and data extraction.

#web-scraping#typescript#mcp-server

Configuration

Local server config is the same for every client. Copy it into your client’s MCP config file.

mcp.json · Universal config
{
  "mcpServers": {
    "usescraper": {
      "command": "npx",
      "args": [
        "-y",
        "@smithery/cli"
      ]
    }
  }
}
Run commandnpx -y @smithery/cli

Local servers need a runtime on your machine (e.g. Node.js 18+). Config file locations differ by client; see your client’s docs.

Packages
npm@smithery/cli

Tools

No tool list yet

Local servers expose tools only once running on your machine, and the maintainer has not provided a tool list.

Details

From the project README

UseScraper MCP Server

smithery badge This is a TypeScript-based MCP server that provides web scraping capabilities using the UseScraper API. It exposes a single tool 'scrape' that can extract content from web pages in various formats.

UseScraper Server MCP server

Features

Tools
  • scrape - Extract content from a webpage
    • Parameters:
      • url (required): The URL of the webpage to scrape
      • format (optional): The format to save the content (text, html, markdown). Default: markdown
      • advanced_proxy (optional): Use advanced proxy to circumvent bot detection. Default: false
      • extract_object (optional): Object specifying data to extract

Installation

Installing via Smithery

To install UseScraper for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install usescraper-server --client claude
Manual Installation

  1. Clone the repository:

    git clone https://github.com/your-repo/usescraper-server.git
cd usescraper-server

  2. Install dependencies:

    npm install

  3. Build the server:

    npm run build

Configuration

To use with Claude Desktop, add the server config:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "usescraper-server": {
      "command": "node",
      "args": ["/path/to/usescraper-server/build/index.js"],
      "env": {
        "USESCRAPER_API_KEY": "your-api-key-here"
      }
    }
  }
}

Replace /path/to/usescraper-server with the actual path to the server and your-api-key-here with your UseScraper API key.

Usage

Once configured, you can use the 'scrape' tool through the MCP interface. Example usage:

{
  "name": "scrape",
  "arguments": {
    "url": "https://example.com",
    "format": "markdown"
  }
}

Development

For development with auto-rebuild:

npm run watch
Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

npm run inspector

The Inspector will provide a URL to access debugging tools in your browser.

Comments

Markdown supported

New to MCP?

From what the protocol is to installing your first server, these answers cover most first questions.

An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.