fix(cli): stop skills update deleting skills the manifest never covered (#3118)

`hyperframes skills update` deleted skills that the same command had just
installed, from every agent directory on the machine, and reported them as
"no longer published".

`skills add --skill '*'` installs every skill in the repo — including the
repo-native ones under `.claude/skills/` and `.agents/skills/` — and the
upstream lock attributes all of them to `heygen-com/hyperframes`. The published
manifest is generated from `<repoRoot>/skills` only (gen-skills-manifest.ts), so
it never lists those. detectRemoved read that silence as "removed upstream" and
pruned them, so `check || update` could not converge: `add` reinstalled them and
the next `update` deleted them again.

Scope removed-detection to skills the manifest is actually authoritative for,
using the lock's `skillPath` — the only field that separates a skill installed
from `skills/` from one installed out of the same repo's other skill roots
(`source` is identical for both). An entry with no `skillPath` is treated as not
covered: this is a delete path, so unknown provenance fails safe.

Also resolve the prune's manifest canonically. Its notion of "still published"
could otherwise come from any `skills-manifest.json` within 16 parent
directories of cwd, which — since HyperFrames' own manifest declares
`source: heygen-com/hyperframes` — matches lock attribution and drives deletion.
The install-side check already did this (#2176); the deleting path did not, and
the comment claiming that was deliberate and "tested separately" had no such
test. An explicit `--source` still wins.

Verified end to end against the real CLI in a sandboxed HOME. Before: `add`
installed 25 skills, `update` printed "Removing 6 skill(s) no longer published:
captions-overlay, changelog-video, cut-the-curve, motion-doctrine,
oversized-cursor, seam-craft" and deleted all six (27 dirs -> 21). After: no
removal line, 27 -> 27. Both new regression tests fail on the pre-fix source.

Fixes #3111
This commit is contained in:
James Russo
2026-08-08 12:43:53 -07:00
committed by GitHub
parent b08cefea63
commit ed3ff98ce0
4 changed files with 187 additions and 11 deletions
+93 -4
View File
@@ -495,8 +495,27 @@ describe("checkSkills removed-upstream detection", () => {
writeFileSync(manifestPath, JSON.stringify(manifest));
return { home, opts: { source: manifestPath, cwd: project, home } };
}
function writeGlobalLock(home: string, skills: Record<string, { source: string }>): void {
writeFileSync(join(home, ".agents/.skill-lock.json"), JSON.stringify({ version: 3, skills }));
// Upstream writes a `skillPath` on every lock entry it creates (verified
// against a real ~/.agents/.skill-lock.json written by skills@1.5.22), and
// removed-detection now reads it to tell manifest-covered skills apart from
// ones installed out of the repo's other skill roots — see
// manifestCoversSkill / GH #3111. Default to the covered root so each existing
// fixture keeps meaning "a normally published skill"; pass skillPath
// explicitly to model anything else.
function writeGlobalLock(
home: string,
skills: Record<string, { source: string; skillPath?: string }>,
): void {
const withPaths = Object.fromEntries(
Object.entries(skills).map(([name, entry]) => [
name,
{ skillPath: `skills/${name}/SKILL.md`, ...entry },
]),
);
writeFileSync(
join(home, ".agents/.skill-lock.json"),
JSON.stringify({ version: 3, skills: withPaths }),
);
}
it("flags a lock-attributed skill the manifest dropped, ignoring other sources", async () => {
@@ -514,6 +533,70 @@ describe("checkSkills removed-upstream detection", () => {
expect(res.summary.removed).toBe(1);
});
// GH #3111 — the data-loss regression. `skills add --skill '*'` installs every
// skill in the repo, including the repo-native ones under `.claude/skills/`
// and `.agents/skills/`, and attributes them all to our source. The published
// manifest is generated from `<repoRoot>/skills` ONLY (gen-skills-manifest.ts),
// so it never lists them — and reading that silence as "no longer published"
// deleted them from every agent directory on the machine, immediately after
// the same command installed them.
//
// Reproduced end-to-end pre-fix against the real CLI: `skills add` installed
// 25 skills, then `skills update` printed "Removing 6 skill(s) no longer
// published: captions-overlay, changelog-video, cut-the-curve, motion-doctrine,
// oversized-cursor, seam-craft" and deleted all six. Their lock entries carried
// `.agents/skills/<name>/SKILL.md`; the survivors carried `skills/<name>/…`.
it("never prunes a skill installed outside the manifest's coverage root", async () => {
const { home, opts } = setup({ source: "test", skills: { alpha: { hash: "x", files: 1 } } });
writeGlobalLock(home, {
alpha: { source: "test" }, // published, in the manifest → untouched
gamma: {
source: "test", // ours, absent from the manifest…
skillPath: ".agents/skills/gamma/SKILL.md", // …but the manifest never covered it
},
});
const res = await checkSkills(opts);
const byName = Object.fromEntries(res.skills.map((s) => [s.name, s.status]));
expect(byName.gamma).not.toBe("removed");
expect(res.summary.removed).toBe(0);
});
// The other half of the contract: the coverage filter must not blunt the
// retired-skill convergence #2176 added. A skill installed FROM `skills/` and
// since dropped from the manifest is still a real removal.
it("still prunes a manifest-covered skill that was genuinely dropped upstream", async () => {
const { home, opts } = setup({ source: "test", skills: { alpha: { hash: "x", files: 1 } } });
writeGlobalLock(home, {
alpha: { source: "test" },
gamma: { source: "test", skillPath: "skills/gamma/SKILL.md" },
});
const res = await checkSkills(opts);
expect(Object.fromEntries(res.skills.map((s) => [s.name, s.status])).gamma).toBe("removed");
expect(res.summary.removed).toBe(1);
});
// Fail safe on unknown provenance: an entry written by an older upstream that
// recorded no skillPath cannot be shown to be manifest-covered, and this is a
// DELETE path — so it is left alone rather than guessed at.
it("leaves an entry with no skillPath alone rather than guessing", async () => {
const { home, opts } = setup({ source: "test", skills: { alpha: { hash: "x", files: 1 } } });
writeFileSync(
join(home, ".agents/.skill-lock.json"),
JSON.stringify({
version: 3,
skills: { alpha: { source: "test" }, gamma: { source: "test" } }, // no skillPath at all
}),
);
const res = await checkSkills(opts);
expect(res.summary.removed).toBe(0);
});
it("a removed skill alone makes an update available (no outdated/missing)", async () => {
// Manifest lists only alpha, with its REAL hash → "current" (not outdated).
const { home, opts } = setup({ source: "test", skills: {} });
@@ -591,7 +674,10 @@ describe("checkSkills removed-upstream detection", () => {
join(project, "skills-lock.json"),
JSON.stringify({
version: 1,
skills: { alpha: { source: "test" }, gamma: { source: "test" } },
skills: {
alpha: { source: "test", skillPath: "skills/alpha/SKILL.md" },
gamma: { source: "test", skillPath: "skills/gamma/SKILL.md" },
},
}),
);
@@ -618,7 +704,10 @@ describe("checkSkills removed-upstream detection", () => {
join(project, "skills-lock.json"),
JSON.stringify({
version: 1,
skills: { alpha: { source: "test" }, gamma: { source: "test" } },
skills: {
alpha: { source: "test", skillPath: "skills/alpha/SKILL.md" },
gamma: { source: "test", skillPath: "skills/gamma/SKILL.md" },
},
}),
);
const home = join(root, "home2");
+44 -1
View File
@@ -429,6 +429,13 @@ export function diffSkills(
interface LockEntry {
source?: string;
sourceUrl?: string;
/**
* Path of the skill's SKILL.md within the source repo, as upstream records it
* (`skills/general-video/SKILL.md`, `.agents/skills/seam-craft/SKILL.md`). The
* only field distinguishing skills the published manifest covers from ones
* installed out of the same repo's other skill roots — see manifestCoversSkill.
*/
skillPath?: string;
}
/** The slice of the vercel-labs/skills lock file we read. */
@@ -508,7 +515,42 @@ interface RemovedResult {
lockMissing: boolean;
}
/** Skills the lock attributes to our source that the manifest no longer ships. */
/**
* The repo directory the published manifest is generated from — see
* `packages/cli/scripts/gen-skills-manifest.ts`, which walks `<repoRoot>/skills`
* and nothing else. Anything installed from a DIFFERENT root of the same repo
* (`.claude/skills/`, `.agents/skills/` — the repo-native contributor skills) is
* outside the manifest's coverage, so the manifest says nothing about it.
*/
const MANIFEST_COVERAGE_ROOT = "skills/";
/**
* Is the manifest authoritative about whether this skill still exists upstream?
*
* Only for skills installed from the directory the manifest is generated from.
* The lock records where in the repo each skill came from (`skillPath`, e.g.
* `skills/general-video/SKILL.md` vs `.agents/skills/seam-craft/SKILL.md`), and
* both carry the same `source`, so source attribution alone cannot tell them
* apart. An entry with no `skillPath` (older lock format) is treated as NOT
* covered — for a delete, unknown provenance must fail safe. GH #3111.
*/
function manifestCoversSkill(entry: LockEntry | undefined): boolean {
const path = entry?.skillPath;
return typeof path === "string" && path.startsWith(MANIFEST_COVERAGE_ROOT);
}
/**
* Skills the lock attributes to our source that the manifest no longer ships.
*
* "Absent from the manifest" only means "removed upstream" for skills the
* manifest actually covers. `skills add --skill '*'` installs every skill in the
* repo — including the repo-native ones under `.claude/skills/` and
* `.agents/skills/`, which the published manifest deliberately omits — and
* attributes them all to our source. Without the coverage filter, every install
* is immediately followed by a prune that deletes those skills as "no longer
* published", so `check || update` never converges: `add` reinstalls them and
* the next `update` deletes them again, forever. GH #3111.
*/
function detectRemoved(
root: SkillRoot,
latest: SkillsManifest,
@@ -516,6 +558,7 @@ function detectRemoved(
): RemovedResult {
const lock = readSkillLock(lockPathForScope(root.scope, opts));
const removed = skillsAttributedToSource(lock, latest.source)
.filter((name) => manifestCoversSkill(lock?.skills?.[name]))
.filter((name) => !(name in latest.skills))
.sort()
.map((name) => ({ name, status: "removed" as const }));