Why Skill Forge?
Skill Forge compiles AI skills where each claim your agent reads points back to a real upstream location: a file:line at a pinned commit when source is available, or a documentation URL when it isnât. Not âsourced from training data.â Not âretrieved from context.â Cited. You can open the upstream repo (or the doc page) and see the function exists in under a minute. That is the core idea. This page explains why it matters, how SKF compares to alternatives, and who itâs for.
The problem youâre hiring SKF to solve
Section titled âThe problem youâre hiring SKF to solveâYour AI agents read your codebase through the lens of whatever happened to be in their training data. When that training data is wrong, stale, or incomplete, your agent invents: function names that donât exist, parameter types that donât match, config options removed two versions ago. You catch some of it in review. You ship some of it by accident. Every sprint, your team spends hours untangling code that only compiles in the AIâs imagination.
SKF treats this as a citation problem, not a model problem. If a skill claims cognee.search() takes query_text as its first parameter, SKF points to cognee/api/v1/search/search.py:L27 at commit 3c048aa4 in the upstream repo. Thatâs the whole pitch: nothing is made up, and everything is falsifiable in 60 seconds.
How SKF compares
Section titled âHow SKF comparesâ| Approach | What it does well | Where it falls short |
|---|---|---|
Skill scaffolding (npx skills init) | Creates a SKILL.md template in the standard skill format | The template holds only placeholder text, so you still write every instruction by hand |
| LLM summarization | Understands context and intent | Generates plausible-sounding content that may not match the actual API |
| RAG (retrieval) or pasting code into the prompt | Finds relevant code snippets | Hands over loose fragments, not a finished skill your agent can follow |
| Manual authoring | High initial accuracy | Drifts as the source code changes, doesnât scale across dependencies |
| IDE built-in context (Copilot, Cursor) | Convenient, zero setup | Uses generic training data, not your projectâs specific integration patterns |
| Skill Forge | Every instruction cites upstream: a source file and line at a pinned commit for source skills, a doc URL for docs-only skills. Falsifiable in 60 seconds. | Coverage depends on which tools youâve installed, which set your capability tier (Quick / Forge / Forge+ / Deep). Quick Skill (QS) makes a best-effort skill with no provenance map. |
What âfalsifiable in 60 secondsâ actually means
Section titled âWhat âfalsifiable in 60 secondsâ actually meansâPick any symbol in any SKF-compiled skill. Three clicks:
- Open the skillâs
metadata.json: it names the upstream repo (source_repo) and the exact commit (source_commit). - Open
provenance-map.jsonin the skillâs forge folder (forge-data/{skill}/{version}/, next to its test report) and find your symbol: it lists the file and line. - Visit the upstream repo at that commit and that line. The signature in the skill should match.
For docs-only skills, the audit shape is the same, with two differences: metadata.json records no commit, and the entries in provenance-map.json cite [EXT:{url}] instead of a file and line. Step 3 becomes âopen the doc URL and confirm the signature matches.â
If it doesnât, thatâs a bug. For a skill from oh-my-skills, open an issue there with the file and line. The fix ships publicly with a new commit SHA and a new provenance map. If a skill you compiled with SKF gets it wrong, open a bug report on SKF. SKF treats any disagreement between claim and source as a defect.
Quick Skill (QS) is the exception. It makes a fast, best-effort skill with a metadata.json but no provenance map, so run Create Skill (CS) from a brief when you need this audit trail.
See the Verifying a Skill page for the full three-step audit on real skills, the test reports that log exactly where coverage falls short, and the scoring formula behind the default 80% pass threshold.
Whoâs this for?
Section titled âWhoâs this for?âThe curious developer
Section titled âThe curious developerâYour agent just hallucinated a method that doesnât exist, again. You want this to stop, and you donât want to read a long architecture reference before running your first command. â Start with Getting Started.
The BMAD user
Section titled âThe BMAD userâYou already use the BMAD Method, with its BMM phases (analysis, planning, solutioning, implementation) or its TEA (Test Architect) and BMB (BMAD Builder) modules, and you want to know where SKF fits. â Read BMAD Synergy for the phase-by-phase integration playbook.
The skeptic
Section titled âThe skepticââAI docs for AIâ sounds like the problem pretending to be the solution. You want receipts before you install anything. â Start with Verifying a Skill: the three-step audit on real skills, including the gaps their own test reports log.
The OSS maintainer
Section titled âThe OSS maintainerâYou want to ship verified skills alongside your library releases: ready for npx skills publish, drift-detectable, and version-pinned.
â See Examples â OSS Maintainer Publishing Official Skills.
The team lead evaluating adoption
Section titled âThe team lead evaluating adoptionâYouâre considering running SKF across a brownfield platform (an existing, already-running codebase). Before you adopt it, you need to know that an update writes a new version beside the previous one instead of overwriting it, that hand-written [MANUAL] sections survive regeneration, and how the health check reports workflow problems.
â Start with Architecture, then Workflows â Update Skill and Workflows â Terminal Step: Health Check.
Not for you ifâŠ
Section titled âNot for you ifâŠâ- You want docs that hand-hold through every happy path with screenshots and emojis. SKF is a citation machine, not a tutorial series.
- You donât have Node.js â„ 22, Python â„ 3.11, and
uvinstalled. SKF is a Node/Python toolchain at its core, and setup stops withoutuv. - You have neither source code nor published documentation for the target. SKF compiles from one or both: a source repo (each citation names a file and line at a pinned commit) or doc URLs (citations as
[EXT:{url}]). A vague description with no upstream artifact to cite isnât enough.
Everything else is downstream of one question: are the instructions your AI reads provably true? If yes, SKF isnât adding value. If you canât be sure, SKF is the tool.
- Install SKF: Node â„ 22, Python â„ 3.11,
uv, and onenpxcommand - Audit a skill in 60 seconds: see the receipts before you install
- Browse real skills: four Deep-tier skills, all shipping their audit trails