About search-discovery-relevance-review
A skill for teams reviewing search and discovery quality. It structures questions about relevance, ranking, filters, zero-result handling, and user trust into an audit and improvement plan with evaluation criteria and ownership.
Key features
- 01Maps corpus, intents, and ranking surfaces
- 02Separates retrieval, filtering, and ranking
- 03Defines relevance evaluations and feedback signals
- 04Plans zero-result recovery and rollout
- 05Produces audits, decision tables, and checklists
Use cases
- 01Auditing search relevance
- 02Investigating zero-result queries
- 03Reviewing ranking changes before launch
- 04Assessing personalization and trust risks
Install
Copy the command and run it in a terminal.
$
npx skills add https:/ / github.com/ sylphxai/ skills --skill search-discovery-relevance-reviewAfter installing, type/search-discovery-relevance-reviewin Claude Code to confirm it loaded.
Bundled filesagents/openai.yamlreferences/search-discovery-relevance-patterns.md
Details
From the project READMESearch Discovery Relevance Review
Use this skill to convert a search, discovery, relevance quality, filters, ranking drift, zero-results, and user trust question into a concrete artifact with owners, gates, metrics, and recovery paths.
Workflow
- Identify searchable corpus, user intents, query types, ranking surfaces, business incentives, cold-start items, and harm from bad relevance.
- Read
references/search-discovery-relevance-patterns.md. - Separate retrieval, filtering, ranking, personalization, editorial curation, sponsored placement, and moderation eligibility.
- Define quality evals, query logs, zero-result recovery, feedback signals, fairness checks, ranking-change rollout, and support/debug tools.
- Produce relevance audit, state machine, decision table, event schema, eval set, and launch checklist.
When not to use
- Do not use for generic advice the base model already handles without this skill's specific artifact contract.
Guardrails
- Do not mix paid placement, editorial quality, eligibility, and organic ranking without labels and governance.
- Do not optimize clicks alone when long-term satisfaction, retained value, or abuse matters.
- Do not hide zero-result or low-confidence states behind random filler results.
- Do not personalize sensitive categories without privacy, fairness, and user control review.
Output format
Discovery context:
Corpus / intent / ranking surface / trust risk:
Relevance improvement plan:
| Area | Decision | Evidence | Risk | Owner |
| --- | --- | --- | --- | --- |
Signals and evals:
- <item> -> <policy, metric, edge case, support note>
Ranking rollout and recovery:
- <trigger> -> <action, communication, owner>
Comments
Markdown supported