mcpField
R
review-doc-consistency

review-doc-consistency

github.com/heyvhuangTesting & quality33866 installsUpdated 30w ago
Repository

About review-doc-consistency

A skill for checking README and documentation against implementation and contract files. It produces evidence-backed issues with severity ratings and a structured review report.

Key features

  1. 01Compare docs with source code and contracts
  2. 02Check claims and configuration values
  3. 03Prioritize security inconsistencies
  4. 04Rate findings by severity
  5. 05Produce Markdown and JSON reports

Use cases

  1. 01Audit README claims against implementation
  2. 02Find outdated API or configuration guidance
  3. 03Review docs for security-related mismatches
  4. 04Create structured documentation review reports

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/heyvhuang/ship-faster --skill review-doc-consistency

After installing, type/review-doc-consistencyin Claude Code to confirm it loaded.

Bundled fileschecklist.mdoutput-format.md

Details

From the project README

Documentation Consistency Reviewer

Goal

Systematically identify all "outdated" or "inconsistent with implementation" descriptions in README + docs/, outputting ≥30 issue items.

Core Principles

  1. Code is truth - When documentation conflicts with code, source code/config/contract files are authoritative
  2. Evidence before conclusions - Each issue must cite code/config location as evidence
  3. Contracts first - OpenAPI/proto/schema/TS types are treated as SSOT (Single Source of Truth)
  4. Security default tightening - Security-related inconsistencies are prioritized as high severity

Review Process

1. Document Enumeration
# Scan scope
- README.md (root directory)
- docs/**/*.md (all documentation)
- Contract files: OpenAPI/proto/GraphQL schema/TS types
2. Document-by-Document Review

For each document:

  1. List key claims/commitments/configs/interface items
  2. Search for corresponding implementation in code
  3. Compare differences: missing/renamed/behavior mismatch/default value mismatch
  4. Record issues using template
3. Cross-Check
  • Reverse check documentation from contract files
  • Reverse check documentation from config files

See checklist.md for detailed review checklist.

Severity Levels

LevelDefinitionExample
P0Security issue/serious misleadingDocs say sandbox enabled but code doesn't enable it
P1Core functionality inconsistencyFollowing docs leads to failure
P2Incomplete examples/naming inconsistencyDoesn't directly block usage
P3Wording/formatting/link minor issuesDoesn't affect functionality
Pending EvidenceSuspicious but insufficient evidenceNeeds further investigation

Output Format

See output-format.md for detailed templates.

Single Issue Item
### [Title]
- **Severity**: P0/P1/P2/P3/Pending Evidence
- **Location**: `<file_path>:<line_number>`
- **Evidence**:
  - Documentation: [quote]
  - Code: [quote]
- **Impact**: [Misleading consequences]
- **Suggestion**: [Minimal fix]
- **Related Principle**: Code is truth/Contracts first/Security default tightening/...
Review Conclusion
## Review Conclusion
- **Verdict**: Pass/Conditional Pass/Fail
- **Summary**: P0:x P1:x P2:x P3:x Pending:x
- **Fix Priority**: P0 → P1 → P2 → P3

Multi-Agent Parallel

For acceleration, split by following dimensions for parallel multi-agent execution:

  1. By document type - One agent each for README, API docs, development guide
  2. By module - One agent per functional module's documentation
  3. By check direction - One checks docs against code, another checks code against docs

Deduplication and unified severity rating needed when aggregating.

Execution

After review completion, output doc-consistency.md report file, and also output doc-consistency.json (structured issue list for aggregation/deduplication/statistics).

Comments

Markdown supported