mcpField
P
paper-evidence-board

paper-evidence-board

github.com/a-green-hand-jackProductivity53 installs
Repository

About paper-evidence-board

paper-evidence-board is a research workflow skill for tracking paper claims, supporting evidence, figure locations, and reviewer risks. It turns evidence gaps into actions such as experiments, analysis, rewriting, or citation work, and can coordinate with project memory and related skills.

Key features

  1. 01Extract claims and record their paper locations
  2. 02Map evidence to claims and figures
  3. 03Classify evidence gaps and plan actions
  4. 04Integrate reviewer risks
  5. 05Track visual conventions for figures and tables
  6. 06Write status back to project memory

Use cases

  1. 01Check claim-evidence alignment before submission
  2. 02Update the paper after new experiment results
  3. 03Choose between new experiments and rewriting
  4. 04Turn reviewer concerns into concrete tasks

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/a-green-hand-jack/ml-research-skills --skill paper-evidence-board

After installing, type/paper-evidence-boardin Claude Code to confirm it loaded.

Bundled files

References and scripts installed along with SKILL.md.

references/
board-schema.md
evidence-gap-triage.md
paper-section-map.md
report-template.md
reviewer-risk-integration.md
update-protocol.md

Details

From the project README

Paper Evidence Board

Maintain the paper-facing view of the research project: which claims the paper makes, what evidence supports them, where they appear, what reviewers may attack, and what actions are needed before submission.

Use this skill when:

  • writing reveals that a paper claim lacks evidence
  • new experiment results require updating paper narrative, figures, or sections
  • review simulation creates experiment or writing actions
  • a paper draft needs claim-evidence alignment before submission
  • figures and tables need to be mapped to paper claims
  • figure/table style needs to be tracked as a writing decision, including palette, markers, symbols, typography, and venue-facing visual conventions
  • the user wants a live evidence board for a paper
  • the project needs to decide whether a gap requires more experiments, rewriting, narrowing a claim, or cutting material

This skill is more specific than research-project-memory: it uses project memory as the source of cross-component truth, but creates a paper-facing board for writing and review decisions.

Pair this skill with:

  • research-project-memory for project-level claim/evidence/provenance/risk/action/handoff IDs and writeback
  • paper-writing-memory-manager when claim/evidence changes should mark paper locations stale, update dependencies, or create writing threads
  • paper-evidence-gap-miner when a claim lacks evidence and existing result CSVs should be mined before planning new compute
  • paper-result-asset-builder when CSV results need to become paper-facing tables, figures, and provenance records
  • conference-writing-adapter when the board shows structural or paragraph-level writing changes
  • experiment-design-planner when the board exposes missing evidence requiring new experiments
  • result-diagnosis when new evidence weakens or complicates a claim
  • paper-reviewer-simulator when the board should be stress-tested from a reviewer perspective
  • figure-results-review when figures/tables need claim-support, caption, statistical, or visual-style review
  • citation-coverage-audit when novelty or related-work gaps appear

Skill Directory Layout

<installed-skill-dir>/
├── SKILL.md
└── references/
    ├── board-schema.md
    ├── evidence-gap-triage.md
    ├── paper-section-map.md
    ├── report-template.md
    ├── reviewer-risk-integration.md
    └── update-protocol.md

Progressive Loading

  • Always read references/board-schema.md, references/evidence-gap-triage.md, and references/update-protocol.md.
  • Read references/paper-section-map.md when building a section-by-section board from a draft.
  • Read references/reviewer-risk-integration.md when using reviewer simulation, real reviews, or venue-specific risks.
  • Use references/report-template.md for substantial board reports.
  • Verify current venue rules or reviewer forms when venue-specific evidence expectations matter.

Core Principles

  • Every major paper claim should have a paper location, evidence status, and reviewer risk.
  • Evidence should point to source artifacts, not only prose memory.
  • A figure/table should have a job: support a claim, answer a reviewer question, or delimit scope.
  • A paper-facing figure/table should also obey the paper's visual style policy, not just display correct numbers.
  • Missing evidence is not a writing problem by default; it may require experiment design, result diagnosis, claim narrowing, or citation work.
  • Do not hide negative or weak results. Mark how they change the claim.
  • Keep the board actionable: each open gap should route to a next skill or action.

Step 1 - Locate Paper and Project Memory

Find:

  • paper root: paper/, current directory, or user-provided path
  • project root, if different
  • memory/claim-board.md
  • memory/evidence-board.md
  • memory/provenance-board.md
  • memory/risk-board.md
  • memory/action-board.md
  • memory/handoff-board.md
  • memory/phase-dashboard.md
  • paper/.agent/paper-status.md
  • paper sources such as main.tex, paper.tex, sections/*.tex, figures, tables, and appendix

If project memory is missing, still build a paper board from the draft, but recommend initializing research-project-memory.

Step 2 - Extract Paper Claims

Read the draft or provided notes and extract:

  • title and abstract claims
  • introduction contribution bullets
  • method claims
  • theory claims
  • experiment claims
  • related-work novelty boundaries
  • limitation and scope claims

Assign or reuse CLM-### IDs. For each claim, record:

  • exact paper location
  • claim type
  • strength
  • current wording risk
  • evidence expected
  • evidence available

Do not treat aspirational contribution language as proven evidence.

Step 3 - Map Evidence to Claims

Read references/board-schema.md.

For every evidence item:

  • identify source path, run ID, table, figure, theorem, citation, or review text
  • link to claim IDs
  • mark status: planned, running, observed, reported, stale, contradicted, or cut
  • mark certainty: observed, user-stated, inferred, stale, or needs-verification
  • state limitations

If evidence is only in a daily log or chat note, mark it accordingly and create an action to verify source artifacts. If evidence may exist in CSV result files but no paper-facing table or figure exists, route to paper-evidence-gap-miner and paper-result-asset-builder before marking the gap as requiring new compute. If evidence changes affect existing paper text, route to paper-writing-memory-manager to mark dependent title, abstract, sections, captions, limitations, or conclusions stale.

Step 4 - Build Section and Figure/Table Map

Read references/paper-section-map.md.

Create:

  • section map: section -> claims -> evidence -> risks -> actions
  • figure/table map: figure/table -> evidence -> claim -> required caption message -> stale status
  • visual style map: palette, method-to-marker mapping, typography, symbols, figure sizing, and table conventions
  • appendix map when relevant

Identify:

  • claims repeated in multiple places with inconsistent strength
  • figures without a claim
  • claims without a figure/table/proof/citation when one is expected
  • stale figures after new results
  • inconsistent colors, symbols, method names, font sizes, or figure sizes across paper visuals
  • result tables not discussed in prose

Step 5 - Triage Evidence Gaps

Read references/evidence-gap-triage.md.

For each gap, decide:

  • mine-existing-results: needs paper-evidence-gap-miner to search existing CSVs, logs, reports, and assets before new compute
  • build-result-asset: needs paper-result-asset-builder to turn reusable CSV evidence into a paper table or figure
  • new-experiment: needs experiment-design-planner after existing results are insufficient
  • result-diagnosis: existing result is ambiguous or contradictory
  • rewrite: evidence exists but prose overclaims or hides it
  • narrow-claim: evidence supports a smaller claim
  • citation-work: claim needs missing related work or attribution
  • cut: claim is not worth supporting
  • accept-risk: limitation can be stated rather than fixed

Every high-risk gap should create an action.

Step 6 - Integrate Reviewer Risks

Read references/reviewer-risk-integration.md.

Use:

  • simulated reviewer risks from paper-reviewer-simulator
  • citation risks from citation-coverage-audit
  • real review risks from rebuttal-strategist
  • venue-specific expectations when known

Map each risk to:

  • claim
  • paper location
  • evidence gap
  • fix type: experiment, analysis, proof, citation, rewrite, figure/table, limitation, or rebuttal
  • priority

Step 7 - Produce Board and Actions

Use references/report-template.md for full output.

If saving to a project and no path is given, use:

paper/.agent/paper-evidence-board.md

Output:

  • paper snapshot
  • claim-evidence matrix
  • section map
  • figure/table map
  • visual style map
  • evidence gaps
  • reviewer-risk map
  • action plan
  • project-memory writeback

Step 8 - Write Back to Project Memory

If the project uses research-project-memory, update:

  • memory/claim-board.md: claim status, wording, paper locations, and weakened/cut claims
  • memory/evidence-board.md: evidence source paths, figure/table mappings, stale status, and limitations
  • memory/provenance-board.md: traceability from runs, CSVs, reports, citations, figures, tables, captions, and result prose to EVD-### and CLM-###
  • memory/risk-board.md: evidence-gap, writing, novelty, baseline, and reviewer risks
  • memory/action-board.md: experiment, diagnosis, rewrite, citation, figure/table, and review actions
  • memory/handoff-board.md: evidence gaps, asset-building needs, review fixes, or writing dependencies that must be consumed by another skill
  • memory/phase-dashboard.md: active paper/evidence gate when claim support changes enough to move or regress the project phase
  • paper/.agent/paper-status.md: current paper section state
  • paper/.agent/visual-style.md: paper-facing figure/table style policy when visual conventions are material
  • paper/.agent/paper-evidence-board.md: the paper-facing board

Do not duplicate long experiment reports. Link to them.

Final Sanity Check

Before finalizing:

  • every major claim has a location and evidence status
  • unsupported claims are marked as planned, narrowed, or cut
  • every main figure/table has a claim-facing job
  • paper-facing figures/tables share consistent colors, markers, symbols, typography, sizing, and notation
  • stale evidence is marked
  • reviewer risks link to actions
  • next actions are routed to the right skill
  • project memory is updated when present

Comments

Markdown supported