mcpField
D
datasets

datasets

github.com/brightdataData & databases272131 installsUpdated 2w ago
Repository

About datasets

The datasets skill helps agents determine whether Bright Data’s Dataset Marketplace has a suitable pre-collected dataset instead of scraping. It checks marketplace coverage and routes the user to the control panel to review samples and buy; the agent does not make purchases.

Key features

  1. 01Check marketplace coverage
  2. 02Distinguish buying from scraping
  3. 03Route users to purchase review
  4. 04Handle existing dataset IDs

Use cases

  1. 01Find a pre-collected corpus for market research
  2. 02Check whether a dataset suits a one-time or scheduled need
  3. 03Redirect a marketplace dataset ID that cannot be triggered

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/brightdata/skills --skill datasets

After installing, type/datasetsin Claude Code to confirm it loaded.

Bundled filesreferences/marketplace.md

Details

From the project README

datasets

Buy the download instead of scraping. The Dataset Marketplace sells data that was already collected. Using it involves no scraping at all. The user buys a dataset and downloads it.

When this is the answer

Three things must all be true. Anything less is a scraping job, not a purchase.

ConditionExample that passesExample that fails
A huge generic corpus, not specific inputs"every US company with more than 50 staff""the follower count for instagram.com/nasa"
Needed once, or on a schedule a dataset subscription coversa one-time training seta nightly price feed
A few months old is finemarket researchlive inventory

Any one of them false and the answer is the scrape skill. Need it once, or on a schedule a dataset subscription covers, buy the dataset. Need it fresher, or for specific inputs, scrape it.

The agent's job: check and route

The agent checks whether the marketplace covers the ask, then hands off. It does not buy. Buying moves money, so a person does it in the control panel at https://brightdata.com/cp/datasets/browse, on their own account, after looking at a sample and the field coverage. There is no reason for an agent to be in that loop.

Evidence costs up to four calls: three free reads and one probe. The probe starts nothing for a download for sale or for a scraper with a required input, but it can start a billed job on a scraper with no required input. The exact calls, and which ids are safe to probe, are in references/marketplace.md. When the check hits, say it in one line:

Bright Data already sells a dataset that looks like this, priced per record, so buying the download may be cheaper and faster than scraping it. Browse it at brightdata.com/cp/datasets/browse. Say the word and I will scrape it instead.

Then stop and wait. Do not build a scraper in the background as a hedge, and do not ask the user for payment details.

The agent cannot price a purchase. GET /datasets/list gives a row's record count (size) but no price. The cost per record and the total appear on the order page in the control panel, so the person decides there.

A dataset_id the user already holds

A user can arrive holding a dataset_id that turns out to be a marketplace row and ask to trigger it. The first job is correcting the premise. It cannot be triggered, it is a download for sale. Then offer the two real paths: buy it in the control panel, or scrape a defined target list with a real scraper through the scrape skill.

references/marketplace.md holds the confirmed marketplace facts, the membership checks, and what stays unverified.

Comments

Markdown supported