mirror of
https://github.com/heygen-com/hyperframes.git
synced 2026-09-07 01:56:04 +00:00
* feat(media-use): resolve official brand logos via a four-tier cascade Third-party brand logos (the meeting's 'credibility signals lost' gap) had no acquisition path: capture only grabs the product's own site assets, and HeyGen asset search returns generic look-alike icons for brand queries (0/3 in testing — an X-in-a-circle for LinkedIn). Workers could only fake a mark or drop it. New resolve type 'logo', four tiers verified by a 54-brand stress test (100% cascade hit across dev tools / big tech / non-tech / CN brands): - svgl — official full-color vector SVGs + wordmark variants (40/54 first-hits); search is substring-based, so entities pass through alias normalization (nextjs → 'next.js', aws → 'amazon web services') - simple-icons (pinned CDN build) — official monochrome glyphs; catches the long tail (nike, visa, toyota, wechat, bytedance) - github org avatar — known-org map only; a brand name is not a GitHub login, guessing risks same-named personal accounts - domain favicon (DuckDuckGo ip3) — small-raster last resort; sub-500B responses are DDG's placeholder and rejected; frozen with a low_res provenance flag (chip-size use only) logo joins the icon/image equivalence group (typesMatch) and the images/ subdir, so entity cache hits interop with figma-imported marks. A total miss falls through resolve's normal failure path — no special casing. HeyGen search stays the icon provider; it is deliberately absent from the logo cascade. Docs: media-use gap/types/providers tables + example; the five workflow banners now cover logos (catalog claim kept for media, 'from their official sources' added for logos); product-launch story-design and motion-graphics logo-reveal point at the new type; catalog surfaces (CLAUDE.md / README / docs) updated in lockstep. Verified: 19 unit tests + coverage row green; live smoke across all four tiers (linkedin→svgl, nike→simple-icons, heygen→github.avatar, amazon→favicon) plus a fabricated brand exiting 1 on the default miss path. oxlint + oxfmt clean. * test(media-use): sanction the four logo providers in the registry allowlist svgl / simple-icons / github.avatar / favicon.ddg join the sanctioned list — the logo cascade added in the previous commit. Full lib suite 95/95 green. * test(media-use): gate the logo cascade behavior in CI + single-fetch favicon tier Review follow-ups (miga-heygen, jrusso1020 on #2061): - Eight mocked-network tests pin what the manual 54-brand stress test only asserted: descriptor shape, alias retry (svgl non-array payload → next query, simple-icons 404 → next slug), network-error → null fallthrough, the sub-500B placeholder rejection, github's no-guessing (zero fetches for unmapped entities), and the real cascade order landing tier by tier under a mocked network. - faviconSearch now hands its verified bytes over as a local file, so the freeze step copies instead of re-downloading — one round-trip, and the size check is authoritative over what gets frozen. - The header's hit counts are labeled as a stress-test snapshot, not a live invariant. Full lib suite 103/103; live smoke re-verified (amazon → favicon.ddg, frozen .ico).
154 lines
6.6 KiB
JavaScript
154 lines
6.6 KiB
JavaScript
// Provider registry — the v2 contract.
|
|
//
|
|
// Each media type maps to an ORDERED list of provider entries. Providers are
|
|
// tried in order; the first to return a non-null result wins, which keeps
|
|
// resolution deterministic (same request -> same provider -> same file ->
|
|
// reproducible renders). heygen-CLI is always first for the types it serves.
|
|
//
|
|
// An entry exposes any of three capability methods — search / generate /
|
|
// process — plus { name }. media-use holds no keys; each external tool owns its
|
|
// own auth. Providers, by type:
|
|
// - heygen CLI: catalog + TTS, first for every type it serves (sub creds)
|
|
// - mflux: local FLUX-class image gen, spec-selected to the machine's RAM
|
|
// (free, private, offline once cached)
|
|
// - codex CLI: image gen on the user's ChatGPT sub — the better-quality upsell
|
|
// and the fallback when no local model fits
|
|
// - Kokoro (via the hyperframes CLI): local voiceover, free/private default
|
|
// for the voice type, ahead of the paid HeyGen TTS upsell
|
|
//
|
|
// Generation is local-first, cloud-upsell. `ctx.provider` forces one provider
|
|
// (e.g. "make an image with codex").
|
|
|
|
import { bgmProvider } from "./bgm-provider.mjs";
|
|
import { sfxProvider } from "./sfx-provider.mjs";
|
|
import { imageProvider, iconProvider } from "./image-provider.mjs";
|
|
import { brandProvider } from "./brand-provider.mjs";
|
|
import {
|
|
svglSearch,
|
|
simpleIconsSearch,
|
|
githubAvatarSearch,
|
|
faviconSearch,
|
|
} from "./logo-provider.mjs";
|
|
import { heygenTtsGenerate } from "./voice-provider.mjs";
|
|
import { localTtsGenerate } from "./tts-local-provider.mjs";
|
|
import { codexImageGenerate } from "./codex-provider.mjs";
|
|
import { mfluxImageGenerate } from "./mflux-provider.mjs";
|
|
|
|
// Provider markers: `network` = hits a remote service (skipped by --local-only).
|
|
// `paid` = costs wallet credits (documentation for the agent's cost judgment,
|
|
// X4: agent-initiated paid should confirm). HeyGen catalog SEARCH is free;
|
|
// HeyGen TTS now costs credits, so it is the paid upsell behind local Kokoro.
|
|
const A = (name, caps) => ({ name, ...caps }); // local, free
|
|
const N = (name, caps) => ({ name, network: true, ...caps }); // remote, free
|
|
const P = (name, caps) => ({ name, network: true, paid: true, ...caps }); // remote, paid
|
|
|
|
// heygen-CLI first (and currently only). All remote providers are skipped by --local-only.
|
|
const REGISTRY = {
|
|
bgm: [N("heygen.audio.sounds", { search: bgmProvider.search })],
|
|
sfx: [N("heygen.audio.sounds", { search: sfxProvider.search })],
|
|
image: [
|
|
N("heygen.asset.search", { search: imageProvider.search }),
|
|
// Catalog miss -> generate. Local first (best FLUX-class model the machine's
|
|
// RAM can run, spec-selected; free, private, kept under --local-only), then
|
|
// the codex CLI on the user's ChatGPT sub as the better-quality upsell and
|
|
// the fallback when no local model fits.
|
|
A("mflux.local", { generate: mfluxImageGenerate }),
|
|
N("codex.image_gen", { generate: codexImageGenerate }),
|
|
],
|
|
icon: [N("heygen.asset.search", { search: iconProvider.search })],
|
|
logo: [
|
|
// Official brand marks. Tiers verified by a 54-brand stress test (100%
|
|
// cascade hit); HeyGen asset search is deliberately absent — it returns
|
|
// generic look-alike icons for brand queries. All free, all network →
|
|
// --local-only leaves only the cache rungs.
|
|
N("svgl", { search: svglSearch }),
|
|
N("simple-icons", { search: simpleIconsSearch }),
|
|
N("github.avatar", { search: githubAvatarSearch }),
|
|
N("favicon.ddg", { search: faviconSearch }),
|
|
],
|
|
voice: [
|
|
// Local Kokoro first (free, private, on-device via the hyperframes CLI, kept
|
|
// under --local-only), then HeyGen TTS as the higher-quality paid upsell and
|
|
// the fallback when Kokoro is not set up.
|
|
A("kokoro.local", { generate: localTtsGenerate }),
|
|
P("heygen.tts", { generate: heygenTtsGenerate }),
|
|
],
|
|
brand: [
|
|
// Local design spec, not heygen — reads frame.md / design.md tokens.
|
|
A("design_spec", { search: brandProvider.search }),
|
|
],
|
|
};
|
|
|
|
function listFor(type) {
|
|
const list = REGISTRY[type];
|
|
if (!list) throw new Error(`unknown media type: ${type}`);
|
|
return list;
|
|
}
|
|
|
|
/** Ordered providers for a type. */
|
|
export function getProviders(type) {
|
|
return listFor(type);
|
|
}
|
|
|
|
/** All declared media types. */
|
|
export function listTypes() {
|
|
return Object.keys(REGISTRY);
|
|
}
|
|
|
|
/** Provider names available for a type, in cascade order (for --provider validation). */
|
|
export function providerNamesFor(type) {
|
|
return listFor(type).map((p) => p.name);
|
|
}
|
|
|
|
/**
|
|
* Does an override token (full name like "codex.image_gen" or a prefix like
|
|
* "codex") match any provider declared for the type? Same match rule as
|
|
* runProviders, so validation and dispatch never disagree.
|
|
*/
|
|
export function providerMatches(type, want) {
|
|
return providerNamesFor(type).some((n) => n === want || n.startsWith(`${want}.`));
|
|
}
|
|
|
|
/**
|
|
* Back-compat shim for the v1 single-provider API. Returns the first declared
|
|
* provider for the type (tagged with `type`); throws for an unknown type.
|
|
* Kept for v1 callers only — new code should use getProviders/runCapability.
|
|
*/
|
|
export function getProvider(type) {
|
|
const first = listFor(type)[0] || {};
|
|
return { ...first, type };
|
|
}
|
|
|
|
/**
|
|
* Run a capability across an explicit ordered provider list. Tries each in
|
|
* order, returns the first non-null result, skips providers that don't expose
|
|
* the capability. Pure over its input — the unit-testable core of the cascade.
|
|
*
|
|
* Offline guard: a `network` provider is skipped when `ctx.localOnly` is set —
|
|
* unconditionally, even under a `ctx.provider` override. --local-only is a hard
|
|
* safety flag: it must never make a network call. Forcing a network provider
|
|
* while offline yields a clean miss (the caller explains the conflict), never a
|
|
* silent network request.
|
|
* Provider override: `ctx.provider` (a full name like "codex.image_gen" or a
|
|
* prefix like "codex") pins resolution to matching providers only — this is how
|
|
* a user "make an image WITH codex" forces the upsell instead of taking the
|
|
* free-first default.
|
|
*/
|
|
export async function runProviders(providers, capability, intent, ctx) {
|
|
const want = ctx?.provider;
|
|
for (const p of providers) {
|
|
if (want && p.name !== want && !p.name.startsWith(`${want}.`)) continue;
|
|
if (p.network && ctx?.localOnly) continue; // --local-only wins, even over --provider
|
|
const fn = p[capability];
|
|
if (typeof fn !== "function") continue;
|
|
const res = await fn(intent, ctx);
|
|
if (res) return res;
|
|
}
|
|
return null;
|
|
}
|
|
|
|
/** Run a capability over the providers for a type (deterministic, heygen-first). */
|
|
export async function runCapability(type, capability, intent, ctx) {
|
|
return runProviders(getProviders(type), capability, intent, ctx);
|
|
}
|