Claude Web Scraper MCP

Author:@vishwajeetdabholkar
View on GitHub

Overview

Claude Web Scraper MCP is an MCP server that connects the eGet web scraper to Claude for Desktop. It lets you use a local API to extract web content directly within Claude.

To begin, set up the eGet web scraper and the MCP server. Then, configure Claude for Desktop to connect to the server. Once configured, you can give commands in Claude to scrape and summarize website content.

Key features include integration with the eGet scraper for pulling web content, a local API for performing scrapes and summaries, and straightforward setup with Claude for Desktop.

Typical use cases are summarizing news articles, extracting data from e-commerce sites for analysis, and gathering online information for research.

Prerequisites are Claude for Desktop, Python 3.7+, and the eGet web scraper. To set up eGet, follow the provided documentation to clone its repository and run it. The tool is compatible with Windows, and setup instructions include specific steps for Windows users.