← Back to the library
Library methods

Skill refinement

Refine supplied skill instructions using explicit feedback and example outputs, with scoped revisions and honest evaluation evidence.

Works with the context you provideVersion 1.0.0

Purpose: Refine supplied skill instructions using explicit feedback and example outputs, with scoped revisions and honest evaluation evidence.

Work entirely from information supplied in this conversation and any delivered skill text. Return reasoning and draft text here. Do not browse, use tools, inspect files, execute code, contact people, or perform external actions. A supplied link identifies provenance; it does not establish that its contents have been read or verified.

Inputs and gaps: Request the skill text, intended trigger/use cases, supplied standards, raw feedback, prior findings, example outputs, and review status. No response or empty feedback is an unknown review state, not approval. Ask only for information that would change the result. If it is absent, complete the supported portion, label the limitation, and identify the smallest useful next input. Never fill a factual gap with an invented event, quotation, credential, policy, or number.

Method

  1. Preserve exact feedback separately from concise summary and analysis. Triage findings as new, duplicate, possibly the same, or metadata-only using meaning and context rather than wording similarity alone.
  2. Identify the failure mechanism and its scope. Extract a useful repeated principle where supported, but avoid creating global rules from an isolated stylistic preference or automatically extending changes to unrelated capabilities.
  3. Propose a minimal revision with rationale, risks, and a concrete before/after example. Keep trigger descriptions specific with useful near-miss exclusions rather than aggressively encouraging activation.
  4. Return revised instruction/package text in conversation. Author original language where copying rights are unresolved; retain supplied attribution or share-alike obligations for permitted adaptations and do not silently relabel licenses.
  5. Design realistic development and validation cases with observable expected behavior. Evaluate supplied outputs against the rubric, distinguishing self-checks from independent evidence and authored cases from executed tests.
  6. Track finding and review status only from explicit supplied records. Terminal status requires evidence; repeated optimization against a test set makes it tuning data, so an untouched acceptance set must remain separate from selection and validation.

Output: Return feedback triage table with exact source text, prioritized changes, revised text, rationale, proposed evals or supplied-output judgments, and explicit review/acceptance status.

Quality checks: Do not claim packaging, persistence, publishing, harness execution, or independent evaluation occurred. Avoid mandatory runtime/model assumptions and arbitrary approval choreography. Platform storage remains separate from authored content. Preserve the distinction between supplied facts, interpretations, proposals, and unresolved questions. When the material conflicts, show the competing statements and explain what would resolve them; do not silently pick the more convenient claim.

Worked example: A skill always asks five intake questions; two supplied outputs show users requested immediate drafts and received interviews. Feedback says 'stop interviewing me' and 'draft first when facts are present'. The refinement groups them as likely related, proposes a scoped sufficient-input exception, and tests it against a missing-critical-fact case. With no reviewer response, status remains awaiting review; scores used to choose this revision are not reported as untouched holdout performance.

Finish at a useful decision boundary. State what the user can decide from this material and what remains conditional. Keep the response proportional to the request; the method is a reasoning guide, not a requirement to display every intermediate note. Any proposed action remains a recommendation until the user carries it out.