About Web Browser Mcp Server
Web Browser MCP server lets AI assistants browse websites and extract page content using BeautifulSoup4. It supports CSS selectors for targeting specific content and is suited to users who need structured data from web pages.
Key features
- 01Extract content using CSS selectors
- 02Capture page titles and links as metadata
- 03Asynchronous request processing
- 04Configurable request timeout
Use cases
- 01Extracting specific sections or data from a web page
- 02Letting an AI assistant read and interpret web content
MCP support
This project is an MCP server that provides a browse_webpage tool to MCP clients for fetching pages and returning extracted content.
Configuration
Local server config is the same for every client. Copy it into your client’s MCP config file.
Tools
Local servers expose tools only once running on your machine, and the maintainer has not provided a tool list.
Details
From the project README✨ Features
🌐 Enable AI assistants to browse and extract content from the web through a simple MCP interface.
The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.
🤝 Contribute • 📝 Report Bug
✨ Core Features
- 🎯 Smart Content Extraction: Target exactly what you need with CSS selectors
- ⚡ Lightning Fast: Built with async processing for optimal performance
- 📊 Rich Metadata: Capture titles, links, and structured content
- 🛡️ Robust & Reliable: Built-in error handling and timeout management
- 🌍 Cross-Platform: Works everywhere Python runs
🚀 Quick Start
Installing via Smithery
To install Web Browser Server for Claude Desktop automatically via Smithery:
npx -y @smithery/cli install web-browser-mcp-server --client claude
Installing Manually
Install using uv:
uv tool install web-browser-mcp-server
For development:
# Clone and set up development environment
git clone https://github.com/blazickjp/web-browser-mcp-server.git
cd web-browser-mcp-server
# Create and activate virtual environment
uv venv
source .venv/bin/activate
# Install with test dependencies
uv pip install -e ".[test]"
🔌 MCP Integration
Add this configuration to your MCP client config file:
{
"mcpServers": {
"web-browser-mcp-server": {
"command": "uv",
"args": [
"tool",
"run",
"web-browser-mcp-server"
],
"env": {
"REQUEST_TIMEOUT": "30"
}
}
}
}
For Development:
{
"mcpServers": {
"web-browser-mcp-server": {
"command": "uv",
"args": [
"--directory",
"path/to/cloned/web-browser-mcp-server",
"run",
"web-browser-mcp-server"
],
"env": {
"REQUEST_TIMEOUT": "30"
}
}
}
}
💡 Available Tools
The server provides a powerful web browsing tool:
browse_webpage
Browse and extract content from web pages with optional CSS selectors:
# Basic webpage fetch
result = await call_tool("browse_webpage", {
"url": "https://example.com"
})
# Target specific content with CSS selectors
result = await call_tool("browse_webpage", {
"url": "https://example.com",
"selectors": {
"headlines": "h1, h2",
"main_content": "article.content",
"navigation": "nav a"
}
})
⚙️ Configuration
Configure through environment variables:
| Variable | Purpose | Default |
|---|---|---|
REQUEST_TIMEOUT | Webpage request timeout in seconds | 30 |
🧪 Testing
Run the test suite:
python -m pytest
📄 License
Released under the MIT License. See the LICENSE file for details.
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.