mcpField
E
experiment-trace-summarizer

experiment-trace-summarizer

github.com/jurgendnData & databases1137 installsUpdated 6w ago
Repository

About experiment-trace-summarizer

experiment-trace-summarizer is a skill for turning experiment logs into decisions. It tracks provenance, distinguishes confirmed results from impressions, and recommends exact next runs.

Key features

  1. 01Collect run settings and results
  2. 02Separate findings from impressions
  3. 03Summarize changes and their effects
  4. 04Record anomalies and open questions
  5. 05Determine the current decision state
  6. 06Recommend the next experiment runs

Use cases

  1. 01Review a series of model experiments
  2. 02Decide whether to rerun, debug, pivot, or stop
  3. 03Preserve evidence when runs conflict

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/jurgendn/agent-skills --skill experiment-trace-summarizer

After installing, type/experiment-trace-summarizerin Claude Code to confirm it loaded.

Details

From the project README

Experiment Trace Summarizer

Compress the run history into decisions.

Intake

Collect the raw trace:

  • run ids, commands, configs, seeds, commits;
  • metrics and plots;
  • notes about anomalies or manual interventions;
  • what changed between runs;
  • current question the experiment was meant to answer.

Workflow

  1. Gather commands, configs, metrics, and observations.
  2. Separate confirmed findings from tentative impressions.
  3. Summarize what changed and what mattered.
  4. List dead ends and unresolved questions.
  5. Identify the current decision state: continue, pivot, debug, rerun, or stop.
  6. Recommend exact next runs.

Rules

  • Preserve provenance for every important number.
  • Do not tidy away contradictory evidence.
  • Do not merge runs with different configs into one conclusion.
  • Mark impressions as impressions until backed by a run.

Output

Return:

  • question being tested;
  • run timeline;
  • confirmed findings;
  • contradictions or anomalies;
  • current decision;
  • next 1-3 runs with exact purpose.

Comments

Markdown supported