mirror of
https://github.com/heygen-com/hyperframes.git
synced 2026-09-01 19:42:03 +00:00
* refactor(product-launch-video): restructure onto script-driven architecture Move product-launch-video onto the shared script-driven authoring flow: build-frame remixes a hyperframes-creative preset onto brand tokens, audio routes through the shared hyperframes-media engine, per-preset caption skins, and every frame is authored as a directed shot. Removes the old bespoke scripts (captions/validate/prep/hoist/…) in favour of the shared lib. assemble-index.mjs keeps upstream #1629's blank/partial scene-file guard (reject an empty or markup-less scene file at assembly, before emitting data-composition-src, and re-dispatch) carried onto the restructured reader. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * refactor(pr-to-video): restructure onto script-driven architecture Move pr-to-video onto the shared script-driven authoring flow: ingest.mjs folds the gh PR artifacts into the synthetic capture package the shared backend (build-frame / captions / assemble-index) reads, add the mechanism beat, route audio through hyperframes-media, and remix a hyperframes-creative preset onto brand tokens via the shared lib. - Fix skill name: pr-to-video-refactor -> pr-to-video (match directory). - Drop a stale faceless-explainer-refactor reference in an ingest.mjs comment. - assemble-index.mjs keeps upstream #1629's blank/partial scene-file guard. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * refactor(faceless-explainer): restructure onto script-driven architecture Move faceless-explainer onto the shared script-driven authoring flow: every visual is invented (typography / abstract graphics / diagram / data-viz) and authored through the shared backend (build-frame remixes a hyperframes-creative preset onto tokens, audio via hyperframes-media, assemble-index builds the standalone index.html) using the shared lib. - Fix skill name: faceless-explainer-refactor -> faceless-explainer (match directory). - assemble-index.mjs keeps upstream #1629's blank/partial scene-file guard. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * chore(skills): refresh test-skills-fresh.sh workflow roster Update the install-and-verify harness to the current surface: 10 workflows (adds website-to-video, embedded-captions, graphic-overlays, slideshow; drops the removed footage-recut) and refreshed example prompts. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * style(product-launch-video): oxfmt storyboard.mjs Run oxfmt over lib/storyboard.mjs — formatting only, no logic change. Fixes the Format / Preflight CI check. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * test(studio): import commitGsapPositionFromDrag from its actual module The function was split out into gsapDragPositionCommit.ts in #1605, but the test kept importing it from ./gsapDragCommit, which no longer exports it — yielding 'is not a function' at runtime. Import from the correct module. Inherited main breakage (same fix as #1631); fixes the Test CI check on this branch independently of merge order. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * chore(hyperframes): refine router skill metadata tags Update the entry router's metadata tags (video / animation / router focus); oxfmt collapses the now-shorter metadata to a single line. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * fix(skills): tighten caption comment-strip + document audio --only merge Review follow-ups (#1635): - captions.mjs (x3): the HTML-comment strip used a single global replace, which CodeQL flags as incomplete multi-character sanitization (a nested/partial pair can re-form a marker the single pass misses). Strip in a fixpoint loop instead. Input is preset-library content, not user-controlled, so this is lint- cleanliness, not XSS defense. - audio.mjs (x3): document that fetch-sfx (--only sfx) MERGES into the neutral audio_engine_meta.json sidecar — the engine reads prev and recomputes only the sfx section, so voices/bgm from the generate pass are preserved (review Q). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * fix(skills): remove existsSync->write TOCTOU in workflow scripts Clears the 9 js/file-system-race CodeQL alerts (captions/audio/transitions x3). Each was an existsSync precheck followed by a later write of the same path: - captions.mjs: caption-overrides shim -> atomic writeFileSync({ flag: 'wx' }). - audio.mjs (sync-durations) + transitions.mjs (inject): drop the existsSync precheck and read directly, surfacing the same friendly error from a try/catch on readFileSync — no check->write gap. Behavior is unchanged (same error messages); these are local single-process deterministic scripts so the race was never a real risk, but this clears the gate. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * fix(skills): paint root composition ground color in assemble-index Per-frame roots carry data-start/data-duration and get clip-gated against the global timeline at render, so only the first frame's window overlaps global 0 — a frame's own full-bleed background can't serve as the video ground, and every frame after the first renders on the bare body color (black). Paint the ground on the always-present root composition using the project's frame.md canvas color (the same role the caption skin maps to --cap-canvas); fall back to the body letterbox color when frame.md is absent or has no resolvable ground. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * chore(hyperframes): drop router-tag edit (moved to the foundation PR) The entry SKILL.md is rewritten wholesale by the frame-presets/media foundation PR (#1632); editing it here too guaranteed a merge conflict. Restore this file to main and let the router-tag tweak live with the rewrite in #1632, so the two PRs no longer both touch it. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
250 lines
8.1 KiB
JavaScript
250 lines
8.1 KiB
JavaScript
// storyboard.mjs — vendored lenient parser for STORYBOARD.md.
|
|
//
|
|
// Faithful plain-JS port of @hyperframes/core/storyboard
|
|
// (packages/core/src/storyboard/parseStoryboard.ts). Vendored because skills
|
|
// ship standalone: installed via `npx skills add`, a skill's scripts can't reach
|
|
// the monorepo's core package, and the core export points at .ts source that
|
|
// `node` (which runs these scripts) can't load. CANONICAL contract = the core
|
|
// parser + skills/hyperframes-core/references/storyboard-format.md; keep this in
|
|
// lockstep. Behavior: never throws, accepts freeform narrative, recognizes
|
|
// Frame/Beat/Scene headings at H2/H3, preserves unknown keys verbatim under
|
|
// `extra` (keys lowercased). Pure node — no deps.
|
|
|
|
export const FRAME_STATUSES = ["outline", "built", "animated"];
|
|
export const DEFAULT_FRAME_STATUS = "outline";
|
|
|
|
// Detection-only frame heading (ends at the keyword); ReDoS-hardened — keep as-is.
|
|
const FRAME_HEADING_RE = /^(#{2,3})[ \t]+(?:frame|beat|scene)\b/i;
|
|
const FRAME_TITLE_SEP_RE = /^[\s.:—-]+/;
|
|
const HEADING_LEVEL_RE = /^(#{1,6})\s+/;
|
|
const META_RE = /^\s*[-*]\s+([A-Za-z_][\w-]*)\s*:\s*(.+?)\s*$/;
|
|
const LEADING_INT_RE = /^(\d+)/;
|
|
const DURATION_NUM_RE = /(\d+(?:\.\d+)?)/;
|
|
const TRANSITION_KEYS = new Set(["transition_in", "transitionin", "transition"]);
|
|
const SCENE_KEYS = new Set(["scene", "description", "summary", "caption"]);
|
|
export const VOICEOVER_ALIASES = ["voiceover", "vo", "voice_over", "narration"];
|
|
const VOICEOVER_KEYS = new Set(VOICEOVER_ALIASES);
|
|
|
|
export function parseStoryboard(source) {
|
|
const warnings = [];
|
|
const { globals, bodyStartLine, body } = parseFrontmatter(source, warnings);
|
|
const frames = parseFrames(body, bodyStartLine, warnings);
|
|
return { globals, frames, warnings };
|
|
}
|
|
|
|
function emptyGlobals() {
|
|
return { extra: {} };
|
|
}
|
|
|
|
function isFrameStatus(value) {
|
|
return FRAME_STATUSES.includes(value);
|
|
}
|
|
|
|
// ── Frontmatter ─────────────────────────────────────────────────────────────
|
|
function findFrontmatterRange(lines, warnings) {
|
|
let start = 0;
|
|
while (start < lines.length && (lines[start] ?? "").trim() === "") start++;
|
|
if ((lines[start] ?? "").trim() !== "---") return null;
|
|
for (let i = start + 1; i < lines.length; i++) {
|
|
if ((lines[i] ?? "").trim() === "---") return { start, end: i };
|
|
}
|
|
warnings.push({
|
|
message: "Frontmatter opening '---' has no closing '---'; treating whole file as body.",
|
|
line: start + 1,
|
|
});
|
|
return null;
|
|
}
|
|
|
|
function parseFrontmatterEntries(lines, start, end, warnings) {
|
|
const globals = emptyGlobals();
|
|
for (let i = start + 1; i < end; i++) {
|
|
const raw = lines[i] ?? "";
|
|
if (raw.trim() === "") continue;
|
|
const colon = raw.indexOf(":");
|
|
if (colon === -1) {
|
|
warnings.push({
|
|
message: `Ignored non key:value frontmatter line: "${raw.trim()}"`,
|
|
line: i + 1,
|
|
});
|
|
continue;
|
|
}
|
|
const key = raw.slice(0, colon).trim().toLowerCase();
|
|
assignGlobal(globals, key, stripQuotes(raw.slice(colon + 1).trim()));
|
|
}
|
|
return globals;
|
|
}
|
|
|
|
function parseFrontmatter(source, warnings) {
|
|
const lines = source.split(/\r?\n/);
|
|
const range = findFrontmatterRange(lines, warnings);
|
|
if (!range) return { globals: emptyGlobals(), bodyStartLine: 1, body: source };
|
|
const globals = parseFrontmatterEntries(lines, range.start, range.end, warnings);
|
|
const body = lines.slice(range.end + 1).join("\n");
|
|
return { globals, bodyStartLine: range.end + 2, body };
|
|
}
|
|
|
|
function assignGlobal(globals, key, value) {
|
|
switch (key) {
|
|
case "format":
|
|
globals.format = value;
|
|
break;
|
|
case "message":
|
|
globals.message = value;
|
|
break;
|
|
case "arc":
|
|
globals.arc = value;
|
|
break;
|
|
case "audience":
|
|
globals.audience = value;
|
|
break;
|
|
default:
|
|
globals.extra[key] = value;
|
|
}
|
|
}
|
|
|
|
// ── Frames ──────────────────────────────────────────────────────────────────
|
|
function openFrameSection(line, headingLine) {
|
|
const match = FRAME_HEADING_RE.exec(line);
|
|
if (!match) return null;
|
|
const headingText = line.slice(match[0].length).replace(FRAME_TITLE_SEP_RE, "").trim();
|
|
return { headingText, headingLine, level: (match[1] ?? "##").length, lines: [] };
|
|
}
|
|
|
|
function endsFrameSection(line, current) {
|
|
if (!current) return false;
|
|
const heading = HEADING_LEVEL_RE.exec(line);
|
|
return heading !== null && (heading[1] ?? "").length <= current.level;
|
|
}
|
|
|
|
function parseFrames(body, bodyStartLine, warnings) {
|
|
const lines = body.split(/\r?\n/);
|
|
const sections = [];
|
|
let current = null;
|
|
for (let i = 0; i < lines.length; i++) {
|
|
const line = lines[i] ?? "";
|
|
const opened = openFrameSection(line, bodyStartLine + i);
|
|
if (opened) {
|
|
sections.push(opened);
|
|
current = opened;
|
|
} else if (endsFrameSection(line, current)) {
|
|
current = null;
|
|
} else if (current) {
|
|
current.lines.push(line);
|
|
}
|
|
}
|
|
return sections.map((section, idx) => buildFrame(section, idx + 1, warnings));
|
|
}
|
|
|
|
function buildFrame(section, index, warnings) {
|
|
const frame = { index, status: DEFAULT_FRAME_STATUS, narrative: "", extra: {} };
|
|
const { number, title } = parseHeading(section.headingText);
|
|
if (number !== undefined) frame.number = number;
|
|
if (title) frame.title = title;
|
|
|
|
const narrativeLines = [];
|
|
for (const line of section.lines) {
|
|
const meta = META_RE.exec(line);
|
|
if (meta) {
|
|
applyMeta(
|
|
frame,
|
|
(meta[1] ?? "").toLowerCase(),
|
|
(meta[2] ?? "").trim(),
|
|
section.headingLine,
|
|
warnings,
|
|
);
|
|
} else {
|
|
narrativeLines.push(line);
|
|
}
|
|
}
|
|
frame.narrative = narrativeLines.join("\n").trim();
|
|
return frame;
|
|
}
|
|
|
|
function parseHeading(text) {
|
|
if (!text) return {};
|
|
const intMatch = LEADING_INT_RE.exec(text);
|
|
if (!intMatch) return { title: text };
|
|
const number = Number.parseInt(intMatch[1] ?? "", 10);
|
|
const rest = text
|
|
.slice((intMatch[0] ?? "").length)
|
|
.replace(/^[\s.:—-]+/, "")
|
|
.trim();
|
|
return { number, title: rest || undefined };
|
|
}
|
|
|
|
// Dispatch a recognized metadata key to its field, else stash under `extra`.
|
|
// Mirrors core's META_SETTERS map exactly (direct keys + alias sets).
|
|
function applyMeta(frame, key, value, headingLine, warnings) {
|
|
switch (key) {
|
|
case "duration":
|
|
applyDuration(frame, value, headingLine, warnings);
|
|
return;
|
|
case "status":
|
|
applyStatus(frame, value, headingLine, warnings);
|
|
return;
|
|
case "poster":
|
|
applyPoster(frame, value);
|
|
return;
|
|
case "src":
|
|
frame.src = value;
|
|
return;
|
|
}
|
|
if (TRANSITION_KEYS.has(key)) {
|
|
frame.transitionIn = value;
|
|
return;
|
|
}
|
|
if (SCENE_KEYS.has(key)) {
|
|
frame.scene = value;
|
|
return;
|
|
}
|
|
if (VOICEOVER_KEYS.has(key)) {
|
|
frame.voiceover = stripQuotes(value);
|
|
return;
|
|
}
|
|
frame.extra[key] = value;
|
|
}
|
|
|
|
function applyPoster(frame, value) {
|
|
const num = DURATION_NUM_RE.exec(value);
|
|
if (num) frame.poster = Number.parseFloat(num[1] ?? "");
|
|
}
|
|
|
|
function applyDuration(frame, value, headingLine, warnings) {
|
|
frame.duration = value;
|
|
const num = DURATION_NUM_RE.exec(value);
|
|
if (num) {
|
|
frame.durationSeconds = Number.parseFloat(num[1] ?? "");
|
|
return;
|
|
}
|
|
warnings.push({
|
|
message: `Frame ${frame.index}: could not parse duration "${value}".`,
|
|
line: headingLine,
|
|
frameIndex: frame.index,
|
|
});
|
|
}
|
|
|
|
function applyStatus(frame, value, headingLine, warnings) {
|
|
const normalized = value.toLowerCase();
|
|
if (isFrameStatus(normalized)) {
|
|
frame.status = normalized;
|
|
return;
|
|
}
|
|
frame.extra.status = value;
|
|
warnings.push({
|
|
message: `Frame ${frame.index}: unknown status "${value}"; defaulting to "${DEFAULT_FRAME_STATUS}".`,
|
|
line: headingLine,
|
|
frameIndex: frame.index,
|
|
});
|
|
}
|
|
|
|
function stripQuotes(value) {
|
|
if (value.length >= 2) {
|
|
const first = value[0];
|
|
const last = value[value.length - 1];
|
|
if ((first === '"' && last === '"') || (first === "'" && last === "'")) {
|
|
return value.slice(1, -1);
|
|
}
|
|
}
|
|
return value;
|
|
}
|