mcpField
V
validate

validate

github.com/datocmsTesting & quality3118 installsUpdated 6d ago
Repository

About validate

A repository-validation skill for maintainers of skill repositories. It runs freshness checks and explains how to address reported metadata, fixture, and stale-result issues.

Key features

  1. 01Run repository validation
  2. 02Check freshness of synced results
  3. 03Report metadata sync issues
  4. 04Identify missing evaluation fixtures

Use cases

  1. 01Validate a skill repository before publishing
  2. 02Find missing trigger evaluation fixtures
  3. 03Check whether results are stale after fixture changes

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/datocms/agent-skills --skill validate

After installing, type/validatein Claude Code to confirm it loaded.

Details

From the project README

Run the repo validator with the freshness gate enabled:

python3 evals/scripts/validate_skill_repo.py --require-fresh-results-sync

If validation fails, read the error output carefully and fix each reported issue:

  • Metadata sync errors: Update the agents/openai.yaml file to match the SKILL.md frontmatter for the affected skill.
  • Missing eval fixtures: Create evals/fixtures/trigger/<skill-name>.json for any skill that lacks one.
  • Stale results: a fixture changed after its results were committed. Do not re-run evals yourself: tell the user, who decides whether to re-run them or delete the stale result files.

After fixing, re-run validation to confirm all checks pass.

Comments

Markdown supported