About Webscraper MCP
Webscraper MCP is an MCP server for extracting webpage text, YouTube transcripts, and PDF content for Claude Desktop. It returns web and document content as text or Markdown for use in answering questions about links.
Key features
- 01Extract webpage text
- 02Retrieve YouTube transcripts
- 03Convert PDF URLs to Markdown
Use cases
- 01Answer questions about a linked webpage
- 02Review a YouTube video from its transcript
- 03Read text from a linked PDF
MCP support
It exposes webpage, YouTube transcript, and PDF extraction tools to MCP clients.
Configuration
Local server config is the same for every client. Copy it into your client’s MCP config file.
We haven’t collected a package or remote endpoint for this server. Follow the instructions in the project README.
Tools
Local servers expose tools only once running on your machine, and the maintainer has not provided a tool list.
Details
From the project READMEWebscraper MCP
An MCP server for claude desktop that allows claude to scrape text on websites by providing claude the link. It can also scrape transcripts from youtube links and pdfs from pdf links.
Tools available:
get_pdf
Convert a URL that leads to a PDF file to markdown text. Args: input_url (str): Path to the PDF file to convert Returns: str: markdown_text
get_webpage_content
Returns the text content on a webpage based on the link provided. Using this tool you can access links provided by the user so you don't have deny those requests. When the user provides a webpage link which is NOT a youtube or github link and asks questions based on that, this function should be called. Args: url: The url from which you want to text to be extracted.
get_youtube_transcript
Use this tool when you receive youtube links from the user. This tool will extract the transcript from the youtube video and return it to you. Therefore if a user asks questions on a youtube video after providing a link, you can answer their question with this tool. Args: url: The url from which you want to text to be extracted.
Certified by MCPReview
https://mcpreview.com/mcp-servers/saishridhar/webscraper
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.