Files
hyperframes/scripts/test-skills-fresh.sh
T
WaterrrForeverandClaude Opus 5.5 2daedcdafc feat(skills): style templates on the HyperFrames plan (#6842)
* fix(cli,skills): say a step's credits are its total, and keep cost out of retries

An out-of-credits refusal named what the step needs, and an agent read
that as the shortfall. It now says the number is the step's total.

After its last try, an agent told the person what was spent and what
another try would cost. The HeyGen reference now says not to.

* fix(cli): plan avatar credits from the HyperFrames price rows

An avatar's credits came from its old API price, about five times what
the plan charges, so --max-credits refused calls that fit and a top-up
asked for too much. They now use the Avatar IV photo row plus the
general avatar video row, 950 credits a minute.

* fix(cli): pin the avatar price test and keep pricing under the comment share

* fix(cli): plan avatar seconds on the Avatar IV row alone

The general avatar row is only checked at admission and billed on
seconds left after Avatar IV, so adding it to every second made a 15 s
script plan at 238 instead of 200 and a 220 limit refuse a call that fits.

* feat(skills): creator templates on the HyperFrames plan

A Pro account asks for a video in a creator's format and the agent pulls that
template on demand. The packs sit in the private bucket behind the plan-gated
bundle route, so a Free account gets a 402 and the upgrade step. A pull costs
no credits; making the film spends them as Reverse does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): make creator-remix the one template skill

SKILL.md holds the catalog, the Pro openings, the pull and the credit
rules. references/remix.md is how to make the episode, from Desktop's
creator-remix with only what the app alone has swapped for the CLI.
The packs now hold only the template, so their hashes change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): the creator-remix skill and its packs

SKILL.md holds the catalog, the Pro openings, the pull and the credit
rules. references/remix.md is how to make the episode, from Desktop's
creator-remix with only what the app alone has swapped for the CLI.
The packs now hold only the template, so their hashes change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(skills): word creator-remix's sign-in steps the way media-use does

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): a creator-remix presenter runs on the plan by default

The person's own HeyGen avatar is recommended, not required: without
one, 小Lin's presenter is made with HeyGen Video 1 from their photo.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(cli): pin template packs whose voice bills the plan first

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(cli): offload media named inside template tags

References in a composition's <template> were never rewritten, because the DOM
query stops at the tag and template.content does not serialize, so the file stayed
in the zip. A stem matched as a plain word and a same-named file elsewhere counted
as a mention too. A 5-minute presented film went from 196 MB to 71 MB.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(cli): lipsync, and avatars that speak a finished voice

Video 1 takes audio as a reference and re-paces it, so a shot's lips follow its
own track and drift up to a second from the voice. generate --type lipsync redoes
the mouth to the exact voice. generate --type avatar takes --audio, and --avatar
for the person's own look, so the lips land on the voice from one job.

Also moves the plan rows to the 2026-10-30 price book, estimates a voice's credits
so --max-credits can hold it, logs jobs from a folder with no project, and describes
the resolve flags.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): presenters go avatar first, and a voice can be stock

The person's own avatar, then Avatar IV from their photo, then Video 1 with
lipsync. With no clone or recording, a stock voice named in the credits. Pins the
five rebuilt packs. The archive test keeps its ../ under GNU tar with -P.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* test(cli): fix avatar price and sfx provider tests, trim comments

A wav gives the avatar price test an exact length on every platform. The
sfx tests now expect HeyGen first. Comment share is back under the base.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(core): read a font shorthand whose size nests parentheses

`font: calc(var(--size) * 1px)/1 "X"` cut at the first closing parenthesis, so a
bad family name failed the render.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(cli): one ledger row per job, and search skips a template's own pictures

A job done at once logs one row, transcribe logs to the project, and resolve no
longer offers a component's file for a search. --reuse and --provider get help text.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): pin the tested template packs, and a board needs no voice

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* test(cli): read the transcribe ledger row as JSON, for Windows paths

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* chore(cli): pin the Big Questions pack without the film length check

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* docs(skills): call them style templates, and the docs example pulls a real slug

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* chore(cli): pin the cleaned template packs

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* docs(skills): drop the stock-presenter ban and the no-spend-before-storyboard rule

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* chore(cli): pin the Paper Trail and Long Story Short packs without the stock-presenter ban

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): rename creator-remix to style-remix, and the five templates to names that say the look

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): style-remix lists the five templates when none is named

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* chore(cli): pin the Finance Explainer pack that varies its motion graphics

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(cli): media-use generate --type cutout takes a shot out of its background on the plan

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* chore(cli): pin the Finance Explainer pack without the provisional variety rule

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* chore(cli): pin the five style packs with variety rules measured on real films

Animated Science gets a worlds-and-boards budget, 3D True Crime a main board and a
brief corner note, 3D Brand caps by measured rate, Finance and Collage set pieces and
more than one look.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* docs(skills): media-use names the on-plan cutout and lipsync commands, not the heygen CLI ones

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(cli): cutout retries dedupe on request_id, uploads carry their real type; style-remix is public

The background-removal route dedupes on the body's request_id and ignores the Idempotency-Key
header, so a retry after a lost answer started a second job: runJob now also sends the key in the
body for such a route. Uploads typed every non-MP4 file as audio, so WebM and MOV inputs were
refused: they now take their type from the extension. Fails without the fix: the new cutout test
in generate.test.ts sees audio/mpeg for WebM and MOV.

style-remix drops metadata.internal and is listed with the other published skills.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* chore(cli): keep the comment share of the touched files at main's

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* docs: count style-remix in the README and CLAUDE.md skill lists

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(skills): rename style-remix to style-sampling

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-03 11:07:02 +00:00

297 lines
13 KiB
Bash
Executable File

#!/usr/bin/env bash
# test-skills-fresh.sh
#
# Generic sandbox for the `test/skills-fresh` branch — fully simulates a real
# user's `npx` install, with BOTH channels coming from the working tree:
# • skills → installed from skills/ via `npx skills add <repo>` (exactly what
# `npx skills add heygen-com/hyperframes` does for a real user)
# • CLI → wired via a `file:` dep so `npx hyperframes` resolves to the LOCAL
# build, which carries this branch's packages/cli/src/capture changes.
# It adds NO CLAUDE.md / AGENTS.md — it mirrors the plain install, nothing more.
# You then launch your agent in the sandbox and type whatever request you want.
#
# Agents: works for Claude Code (default) and Codex. `--agent` is passed straight
# to `skills add`, so the skills land in that agent's project dir:
# • claude-code → .claude/skills/ (launch: claude --dangerously-skip-permissions)
# • codex → .agents/skills/ (launch: codex --dangerously-bypass-approvals-and-sandbox)
# ← both launch fully auto (no approval prompts); codex stays
# project-local and does NOT touch your global ~/.codex/skills.
#
# Why a sandbox (and not `npx skills add heygen-com/hyperframes#test/skills-fresh`):
# `skills add` only copies skills/. The capture tool you changed lives in
# packages/cli (the @hyperframes/cli package), so an online skills-only install
# would pull this branch's skills but the PUBLISHED CLI's old capture. This
# script builds + file:-links the local CLI so capture comes from the branch too.
#
# Usage:
# bash scripts/test-skills-fresh.sh # Claude Code (default)
# bash scripts/test-skills-fresh.sh --agent codex # Codex
# bash scripts/test-skills-fresh.sh --rebuild # force a CLI rebuild
# bash scripts/test-skills-fresh.sh --no-build # skip the build step
# bash scripts/test-skills-fresh.sh -h # help
#
# What it does:
# 1. Verifies prerequisites (bun, npm, the chosen agent, optionally Chrome).
# 2. Builds the local CLI if dist/cli.js is missing OR any packages/cli source
# is newer than the built bundle (so your capture edits are never tested stale).
# 3. Creates a fresh WORKSPACE ROOT under /tmp/skills-fresh-<timestamp>/ with a
# package.json (`file:` CLI dep). It does NOT init a hyperframes project here
# — the agent runs `npx hyperframes init` inside its own subdirs.
# 4. Runs npm install (file: dep), then installs the CLI into a sandbox-private
# npm global prefix ($TEST_DIR/.npm-global). npx checks that prefix before its
# ~/.npm/_npx cache, so `npx hyperframes` resolves to the LOCAL build from any
# cwd — agents run it from scratchpads / home after shell resets, where the
# file: dep is invisible and npx would silently use the published CLI.
# 5. Installs the full skills tree from the LOCAL repo via `npx skills add
# --agent <agent>`, then prunes the internal _meta/ authoring skills so the
# installed set matches what an end user gets.
# 6. Verifies the 7 published skills landed.
# 7. Prints the command to start the agent + example prompts to try.
#
# Iterate after editing:
# • skills → re-run this script (fresh dir), or in the existing test dir:
# rm -rf <skills-dir>/<name> && npx --yes skills add <repo> \
# --skill <name> --agent <agent> --yes
# • capture / CLI → just re-run this script; step 2's staleness check rebuilds.
set -uo pipefail
# --------- defaults ---------
EXPECTED_BRANCH="test/skills-fresh"
AGENT="claude-code"
# --------- arg parse ---------
BUILD_MODE="auto" # auto | force | skip
while [[ $# -gt 0 ]]; do
case "$1" in
-h|--help)
sed -n '2,40p' "$0" | sed 's/^# \{0,1\}//'
exit 0
;;
--agent) AGENT="${2:-}"; shift 2 ;;
--rebuild) BUILD_MODE="force"; shift ;;
--no-build) BUILD_MODE="skip"; shift ;;
*)
echo "Unknown arg: $1" >&2
echo "Run with --help for usage." >&2
exit 1
;;
esac
done
if [[ -z "$AGENT" ]]; then
echo "--agent needs a value (e.g. claude-code, codex)" >&2
exit 1
fi
# Map the agent to its project skills dir + launch binary.
case "$AGENT" in
claude-code) SKILLS_DIR=".claude/skills"; AGENT_BIN="claude"; LAUNCH="claude --dangerously-skip-permissions" ;;
codex) SKILLS_DIR=".agents/skills"; AGENT_BIN="codex"; LAUNCH="codex --dangerously-bypass-approvals-and-sandbox" ;;
*) SKILLS_DIR=".agents/skills"; AGENT_BIN="$AGENT"; LAUNCH="$AGENT" ;;
esac
# --------- self-locate the hyperframes repo ---------
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
HF_REPO="$(cd "$SCRIPT_DIR/.." && pwd)"
HF_CLI_PKG="$HF_REPO/packages/cli"
HF_CLI_BIN="$HF_CLI_PKG/dist/cli.js"
# --------- pretty output helpers ---------
say() { printf "\033[1;36m→ %s\033[0m\n" "$*"; }
ok() { printf " \033[0;32m✓\033[0m %s\n" "$*"; }
warn() { printf " \033[0;33m! %s\033[0m\n" "$*"; }
fail() { printf " \033[0;31m✗ %s\033[0m\n" "$*"; exit 1; }
# --------- step 1: prerequisites ---------
say "Checking prerequisites (agent: $AGENT)..."
command -v bun >/dev/null 2>&1 || fail "bun not installed. Install: curl -fsSL https://bun.sh/install | bash"
command -v npm >/dev/null 2>&1 || fail "npm not installed (need Node.js — install Node 22+)."
ok "bun: $(bun --version)"
ok "node: $(node --version)"
ok "npm: $(npm --version)"
if command -v "$AGENT_BIN" >/dev/null 2>&1; then
ok "$AGENT_BIN on PATH"
else
warn "$AGENT_BIN not on PATH — install the $AGENT CLI before running the test."
fi
CHROME_MAC="/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
CHROME_LINUX="/usr/bin/chromium"
if [[ -x "$CHROME_MAC" ]] || [[ -x "$CHROME_LINUX" ]]; then
ok "Chrome / Chromium found (capture / web-extraction needs headless Chrome)"
else
warn "No Chrome at $CHROME_MAC or $CHROME_LINUX — capture-based workflows will fail without it"
fi
CURRENT_BRANCH="$(cd "$HF_REPO" && git rev-parse --abbrev-ref HEAD 2>/dev/null || echo unknown)"
if [[ "$CURRENT_BRANCH" != "$EXPECTED_BRANCH" ]]; then
warn "Repo is on '$CURRENT_BRANCH', not '$EXPECTED_BRANCH' — you'll be testing whatever is checked out."
else
ok "repo on branch: $CURRENT_BRANCH"
fi
# --------- step 2: build local CLI (staleness-aware) ---------
say "Checking local CLI build..."
needs_build() {
[[ ! -f "$HF_CLI_BIN" ]] && return 0
# any CLI source (incl. capture/) newer than the built bundle → rebuild,
# so your working-tree edits are never silently tested against a stale dist.
local newer
newer="$(find "$HF_CLI_PKG/src" "$HF_CLI_PKG/scripts" -type f -newer "$HF_CLI_BIN" 2>/dev/null | head -1)"
[[ -n "$newer" ]] && return 0
return 1
}
DO_BUILD=0
case "$BUILD_MODE" in
force) DO_BUILD=1; warn "--rebuild: forcing a fresh CLI build" ;;
skip) warn "--no-build: skipping build; using existing dist (may be stale!)" ;;
auto) if needs_build; then
DO_BUILD=1
[[ -f "$HF_CLI_BIN" ]] && warn "CLI source is newer than dist — rebuilding to pick up your capture/CLI edits" \
|| warn "CLI not built — building (~1-2 min)..."
fi ;;
esac
if [[ "$DO_BUILD" == "1" ]]; then
(cd "$HF_REPO" && bun install && bun run build) || fail "CLI build failed."
[[ -f "$HF_CLI_BIN" ]] || fail "Build completed but $HF_CLI_BIN still missing."
fi
ok "local CLI: $(node "$HF_CLI_BIN" --version 2>/dev/null || echo unknown)"
# --------- step 3: scaffold a fresh test project ---------
TEST_PARENT="${TEST_PARENT:-/tmp}"
TEST_NAME="skills-fresh-$(date +%H%M%S)"
TEST_DIR="$TEST_PARENT/$TEST_NAME"
say "Creating test project at $TEST_DIR ..."
mkdir -p "$TEST_PARENT"
cd "$TEST_PARENT"
[[ -e "$TEST_NAME" ]] && fail "$TEST_DIR already exists. Wait 1s and re-run."
# WORKSPACE ROOT, not a hyperframes project: the agent runs
# `npx hyperframes init` inside their own subdirs, so a project at the root would
# make a skill find a stray composition here. We only need a package.json with the
# `file:` CLI dep so `npx hyperframes` (and the skills' init/render calls from
# subdirs) resolve to the local build.
mkdir -p "$TEST_NAME"
cd "$TEST_NAME"
cat > package.json <<JSON
{
"name": "$TEST_NAME",
"private": true,
"type": "module",
"dependencies": {
"hyperframes": "file:$HF_CLI_PKG"
}
}
JSON
ok "package.json points hyperframes → file:$HF_CLI_PKG"
# --------- step 4: npm install (NOT bun) ---------
# MUST be npm: bun follows the cli pkg's `workspace:*` devDependencies and fails.
# npm only resolves the file: package's `dependencies`.
say "Running npm install (must be npm here, not bun)..."
npm install --no-audit --no-fund --silent || fail "npm install failed."
[[ -x "node_modules/.bin/hyperframes" ]] || fail "node_modules/.bin/hyperframes missing after install."
ok "node_modules/.bin/hyperframes → local CLI"
# --------- step 4.5: sandbox-private npm global prefix (npx-leak guard) ---------
# The file: dep only covers `npx hyperframes` run somewhere UNDER $TEST_DIR — npx
# walks up from cwd looking for node_modules/.bin. Agents routinely run it from
# OUTSIDE the tree (session scratchpads, home after a shell cwd reset); there the
# walk finds nothing, npx falls back to ~/.npm/_npx, and the run silently tests
# the PUBLISHED CLI instead of the branch (same version string, so nothing warns).
# npx checks the npm global prefix BEFORE that cache, so installing the local CLI
# into a sandbox-private prefix — exported at launch — closes the leak from any cwd.
say "Installing local CLI into sandbox npm global prefix (npx-leak guard)..."
NPM_GLOBAL_PREFIX="$TEST_DIR/.npm-global"
npm install -g "file:$HF_CLI_PKG" --prefix "$NPM_GLOBAL_PREFIX" --no-audit --no-fund --silent \
|| fail "global-prefix install failed."
[[ -x "$NPM_GLOBAL_PREFIX/bin/hyperframes" ]] || fail "$NPM_GLOBAL_PREFIX/bin/hyperframes missing after install."
ok "npx hyperframes now resolves to the local build from ANY directory (launch with the env below)"
# --------- step 5: install skills from the local repo, then prune _meta ---------
say "Installing skills from the local repo (--agent $AGENT) ..."
npx --yes skills add "$HF_REPO" --skill '*' --agent "$AGENT" --yes \
|| fail "skills add failed."
# Resolve where they actually landed (claude-code → .claude/skills,
# codex/others → .agents/skills); fall back to whichever dir got populated.
if [[ ! -d "$SKILLS_DIR" ]]; then
for d in .claude/skills .agents/skills .cursor/skills; do
[[ -d "$d" ]] && SKILLS_DIR="$d" && break
done
fi
[[ -d "$SKILLS_DIR" ]] || fail "No skills dir found after install (looked for .claude/skills, .agents/skills, .cursor/skills)."
ok "skills installed under $SKILLS_DIR/"
# skills add walks skills/_meta/ too — those are internal authoring skills, not
# part of the end-user set. Prune them so the sandbox matches a real install.
if [[ -d "$HF_REPO/skills/_meta" ]]; then
for meta in "$HF_REPO/skills/_meta"/*/; do
[[ -d "$meta" ]] || continue
name="$(basename "$meta")"
if [[ -d "$SKILLS_DIR/$name" ]]; then
rm -rf "$SKILLS_DIR/$name"
ok "pruned internal meta-skill: $name"
fi
done
fi
# --------- step 6: verify the skills landed ---------
say "Verifying skill installation..."
SKILLS=(hyperframes hyperframes-cli hyperframes-registry media-use \
figma slideshow remotion-to-hyperframes reverse-any-video style-sampling)
MISSING=()
check_skill() { if [[ -d "$SKILLS_DIR/$1" ]]; then ok "$SKILLS_DIR/$1/"; else MISSING+=("$1"); fi; }
for s in "${SKILLS[@]}"; do check_skill "$s"; done
if [[ ${#MISSING[@]} -gt 0 ]]; then
warn "Missing skill(s): ${MISSING[*]}"
warn "Check skills/ in the repo and re-run."
fi
INSTALLED_COUNT=$(find "$SKILLS_DIR" -maxdepth 1 -mindepth 1 -type d 2>/dev/null | wc -l | tr -d ' ')
ok "$INSTALLED_COUNT skill(s) installed under $SKILLS_DIR/"
# --------- step 7: print next steps ---------
echo ""
printf "\033[1;32m========================================================\033[0m\n"
printf "\033[1;32m Sandbox ready — branch skills + branch CLI (capture).\033[0m\n"
printf "\033[1;32m========================================================\033[0m\n"
echo ""
echo "Project: $TEST_DIR"
echo "Agent: $AGENT (skills in $SKILLS_DIR/)"
echo "CLI: file:$HF_CLI_PKG (local build — includes your capture changes)"
echo "Branch: $CURRENT_BRANCH"
echo ""
echo "To start, run (the env line is the npx-leak guard — without it, npx run outside"
echo "the sandbox tree silently falls back to the PUBLISHED CLI in ~/.npm/_npx):"
echo ""
printf " \033[1;37mcd %s\033[0m\n" "$TEST_DIR"
printf " \033[1;37mnpm_config_prefix=\"%s\" PATH=\"%s/bin:\$PATH\" %s\033[0m\n" "$NPM_GLOBAL_PREFIX" "$NPM_GLOBAL_PREFIX" "$LAUNCH"
echo ""
echo "Then type any request you want to test — /hyperframes picks it up. e.g.:"
echo " • \"make a product launch video for https://your-site.com/\" (exercises capture)"
echo " • \"explain how transformers work as a faceless explainer video\""
echo " • \"make a video from this PR: owner/repo#123\""
echo " • \"add lower-thirds / overlay cards to ./clip.mp4\""
echo " • \"add captions/subtitles to ./clip.mp4\""
echo " • \"a logo reveal / title card / data montage\""
echo ""