mcpField
S
scraping-skills

scraping-skills

github.com/wentoraiData & databases307161 installsUpdated 19w ago
Repository

About scraping-skills

scraping-skills is a collection of six skills for ethical web scraping, dataset discovery, and repository metadata collection. It is intended for research data collection, with guidance spanning APIs, no-code tools, and OAI-PMH.

Key features

  1. 01Six data collection skills
  2. 02Ethical scraping guidance
  3. 03Research dataset discovery
  4. 04Visual no-code collection guide
  5. 05OAI-PMH repository harvesting

Use cases

  1. 01Find and download research datasets
  2. 02Collect Google Scholar data ethically
  3. 03Harvest open repository metadata
  4. 04Choose API-based collection methods

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/wentorai/research-plugins --skill scraping-skills

After installing, type/scraping-skillsin Claude Code to confirm it loaded.

Details

From the project README

Web Scraping & Data Collection — 6 Skills

Select the skill matching the user's need, then read its SKILL.md.

SkillDescription
academic-web-scrapingEthical web scraping and API-based data collection for research
dataset-finder-guideSearch and download research datasets from Kaggle, HuggingFace, and repos
easy-spider-guideGuide to EasySpider for visual no-code web data collection
google-scholar-scraperEthical Google Scholar data collection techniques and best practices
repository-harvesting-guideHarvest metadata from open repositories using OAI-PMH protocol
web-scraping-ethics-guideScrape web data ethically and legally for research purposes

Comments

Markdown supported