About change-impact-analysis
A skill for engineers assessing how code, configuration, data, or dependency changes affect capabilities, tests, and release risk. It structures evidence and uncertainty into an actionable review, including when information is incomplete.
Key features
- 01Maps changes to dependent capabilities and tests
- 02Traverses direct and transitive consumers
- 03Separates facts, assumptions, and unknowns
- 04Ranks risks by impact and evidence
- 05Defines validation and residual risk
Use cases
- 01Assess regression scope after a code or configuration change
- 02Review data and API compatibility before release
- 03Improve an existing impact plan or evidence set
Install
Copy the command and run it in a terminal.
npx skills add https:/ / github.com/ naodeng/ awesome-qa-skills --skill change-impact-analysisAfter installing, type/change-impact-analysisin Claude Code to confirm it loaded.
Bundled files
References and scripts installed along with SKILL.md.
agents/openai.yamlevals/eval.yamlevals/cases/basic-success.yamldomain-method-regression.yamledge-incomplete-input.yamledge-risk-priority.yamlphase-1-project-context.yamlevals/fixtures/check_domain_decisions.pycheck-domain-decisions.shdomain-oracle.jsonprompts/change-impact-analysis.mdreferences/domain-decision-example.mdDetails
From the project READMEChange Impact Analysis
When to Use
- Use this skill when you need to identify affected capabilities, regression scope, and release risk from code, configuration, data, and dependency changes.
- Use it to review an existing plan, result, or evidence set and produce actionable improvements.
- Use it when context is incomplete but a bounded first pass is still valuable.
Output Format Options
- Default to Markdown for review, execution, and incremental refinement.
- When the user requests tables, CSV, JSON, or ticket fields, preserve risk, evidence, priority, and boundary information.
- For machine-consumed output, confirm the schema, enums, and required fields first.
How to Use
- Read and follow
prompts/change-impact-analysis.md, including its input contract, execution rules, minimum coverage, and output order. - Add only context that changes the decision: scope, environment, version, constraints, evidence, and success criteria.
- Audit the input, then separate confirmed facts, working assumptions, and open questions.
- Rank by risk and evidence strength, and produce an artifact that can be executed or reviewed directly.
- If information is missing, deliver a bounded first pass and state which conclusions remain unsupported.
Reference Files
-
When calibrating domain outcomes, valid controls, or evidence gaps, read references/domain-decision-example.md for sanitized input, per-item oracles, and reproducible calculations.
-
Always read
prompts/change-impact-analysis.md; it is the complete execution specification for this skill. -
For evaluation or regression, read
evals/eval.yamland the relevant cases underevals/cases/. -
Load
references/,examples/,scripts/, oroutput-formats.mdonly when those directories exist and the task needs them.
Domain Execution Essentials
- Fix change version/scope and build typed changed file/symbol/config→dependent→business obligation→test ID evidence edges with source/version and confirmed/candidate/unknown states.
- Traverse direct/transitive consumers with cycle deduplication. Stop only at evidenced contract isolation/no-consumer boundaries and record why; directories alone are no boundary.
- Dynamic registration/runtime configuration/untraced dependencies remain unknown. Propose risk-based consumer contract/integration checks; absent mapping does not mean no impact.
- Explain inclusion/exclusion, minimum validation, residual risk, and expansion triggers. This Skill covers code/data/config changes broadly; the PR-specific counterpart owns base/head/diff identity.
Core Constraints
- separate confirmed from inferred impact
- do not select tests only by changed files
- flag untraceable dependencies as risk
- Never invent system behavior, fields, data, metrics, or root causes absent from the evidence.
- Link important conclusions to evidence; mark unsupported conclusions as hypotheses with a verification method.
- Explain priority using business impact, likelihood, or detectability.
Delivery Checklist
- Covered: direct impact, transitive impact, data compatibility, API contracts, permissions, runtime dependencies, rollback, observability.
- Separated facts, assumptions, gaps, and recommendations.
- Gave high-risk items a priority, evidence basis, owner or next action.
- Defined verifiable decision criteria instead of generic advice.
- Performed no unauthorized production writes or destructive actions.
Common Pitfalls
- Listing checks without preconditions, expected outcomes, or evidence.
- Marking everything high priority and avoiding tradeoffs.
- Substituting tool names or generic theory for domain reasoning.
- Refusing incomplete input, or pretending incomplete evidence supports certainty.
Best Practices
- Start with paths most likely to cause business loss, safety issues, or release blockage.
- Reduce uncertainty through the smallest verifiable experiment and record reproduction conditions.
- Make the artifact executable and independently reviewable by another engineer.