Files
Vance Ingalls efe643c37e feat(studio,core,player): stream VST-processed audio in the studio player
Wires the browser half of the pipeline. The sidecar returns processed PCM over
one WebSocket, which a ring buffer feeds to an AudioWorklet so a track plays
its wet signal in preview.

The whole app shares exactly one sidecar connection, mounted once in
NLEProvider and handed to consumers through context. The wire protocol cannot
safely tell two independent connections apart, so a second connection is a
correctness problem, not just overhead.

Because the worklet now owns a VST track's audio, the element itself must stay
muted. Every place that writes .muted or .volume across media elements — the
runtime control bridge, the player's parent-media adoption, the timeline scrub
helper — skips elements marked data-vst-chain. Without that, an unrelated
volume or mute change silently swaps the processed stream back for the
untreated one.

STUDIO_VST_ENABLED gates the surface off by default from its first commit, so
no partially-wired FX UI is reachable while the stack lands.

The VstHostApi contract lives in propertyPanelVstShared (a plain module) rather
than in the panel component, so these hooks no longer import their own
interface back out of the UI layer.
2026-07-31 02:24:18 -07:00
..
…
2026-07-30 10:38:10 -07:00
…

@hyperframes/core

Types, parsers, generators, compiler, linter, runtime, and frame adapters for the Hyperframes video framework.

Install

npm install @hyperframes/core

Most users don't need to install core directly — the CLI, producer, and studio packages depend on it internally.

What's inside

Module Description
Types TimelineElement, CompositionSpec, Asset, canvas dimensions, defaults
Parsers parseHtml — extract timeline elements from HTML; parseGsapScript — parse GSAP animations
Generators generateHyperframesHtml — produce valid Hyperframes HTML from a composition spec
Compiler compileTimingAttrs — resolve data-start / data-duration into absolute times
Linter lintHyperframeHtml — validate Hyperframes HTML (missing attributes, overlapping tracks, etc.)
Runtime IIFE script injected into the browser — manages seek, media playback, and the window.__hf protocol
Frame Adapters Pluggable animation drivers (GSAP, Lottie, CSS, or custom)

Frame Adapters

A frame adapter tells the engine how to seek your animation to a specific frame:

import { createGSAPFrameAdapter } from "@hyperframes/core";

const adapter = createGSAPFrameAdapter({
  getTimeline: () => gsap.timeline(),
  compositionId: "my-video",
});

Implement FrameAdapter for custom animation runtimes:

import type { FrameAdapter } from "@hyperframes/core";

const myAdapter: FrameAdapter = {
  id: "my-adapter",
  getDurationFrames: () => 300,
  seekFrame: (frame) => {
    /* seek your animation */
  },
};

Parsing and generating HTML

import { parseHtml, generateHyperframesHtml } from "@hyperframes/core";

const { elements, metadata } = parseHtml(htmlString);
const html = generateHyperframesHtml(spec);

Linting

import { lintHyperframeHtml } from "@hyperframes/core/lint";

const result = lintHyperframeHtml(htmlString);
// result.findings: { severity, message, elementId }[]

Documentation

Full documentation: hyperframes.heygen.com/packages/core