mirror of
https://github.com/heygen-com/hyperframes.git
synced 2026-09-03 04:38:33 +00:00
ukimsanov
158d0fea1f
Thirty-two published videos were the raw render output. One 20-second catalog preview was 60 MB at 25 Mbps — Blu-ray bitrate for a screen capture in a docs page. Nothing autoplays, so no page shipped that silently, but a reader who pressed play paid for it. Re-encoded at 1280 wide, CRF 28, faststart, keeping audio where it existed. Measured PSNR against the originals at ~38.5 dB, which is visually identical — the first check I ran returned nothing and I mistook that for a pass, so this number comes from a filter that actually worked. Worth correcting one thing I said earlier: the catalog is not systemically over-encoded. 190 videos, 0.36 GB, about 1.9 MB each. Six were over 10 MB. I found two monsters and generalised from them. Pages carrying more than 8 MB of video: 26 before, and the heaviest went from 140 MB to under 15 MB. The durable fix is in generate-catalog-previews.ts, which had no delivery encode at all — it published the render master directly. It has a web pass now, so the next preview is born small instead of being cleaned up later.
69 lines
2.8 KiB
Plaintext
69 lines
2.8 KiB
Plaintext
---
|
||
title: "Create a music-driven video"
|
||
sidebarTitle: "Music video"
|
||
description: "Cut footage, images, lyrics, and motion to a track’s beat grid."
|
||
---
|
||
|
||
import { DocsVideo } from "/snippets/docs-video.jsx";
|
||
|
||
Start with a music file—or a video whose audio should control the edit. Narration is not added; the track is the spine.
|
||
|
||
<Frame caption="A complete music-driven film. Its sections, visual treatments, and cuts follow the track.">
|
||
<DocsVideo
|
||
title="A complete music-driven film"
|
||
src="https://static.heygen.ai/hyperframes-oss/docs/images/showcase/full-music-v2.mp4"
|
||
poster="https://static.heygen.ai/hyperframes-oss/docs/images/showcase/wfv2-music.jpg"
|
||
/>
|
||
</Frame>
|
||
|
||
## Make the request
|
||
|
||
Attach the track and any media that must appear:
|
||
|
||
```text
|
||
Using /hyperframes, turn assets/song.wav and the photos in assets/tour into a
|
||
30-second music-driven video.
|
||
```
|
||
|
||
The agent analyzes the real track before planning the cut. Mention a required
|
||
section, lyric, image order, or delivery format when it cannot be chosen freely.
|
||
|
||
## What should the track drive?
|
||
|
||
- **Use your photos or video** — cut approved media to the track's phrases, energy, beats, and ending.
|
||
- **Make a lyric video** — verify the words first, then synchronize and design each line around the vocal.
|
||
- **Invent the visuals** — build the visual arc from typography, graphic elements, and motion when no media is supplied.
|
||
|
||
A complete video can also be built entirely from type, graphic templates, and
|
||
motion.
|
||
|
||
## The track sets the structure
|
||
|
||
HyperFrames maps the track’s phrases, energy, onsets, silences, rolls, drops, and hard stops before it plans the visuals.
|
||
|
||
A rhythmic track can support cuts on its real beat grid. Calm or loose music should flow by phrase and energy instead of forcing a cut onto every measured beat.
|
||
|
||
The visual treatments change at meaningful musical moments. More beats do not automatically mean more scenes.
|
||
|
||
## Review the rhythm
|
||
|
||
- The correct section of the track is used.
|
||
- Required media appears and lyrics match the vocal.
|
||
- The strongest visual changes land on meaningful musical changes.
|
||
- Important images and text remain long enough to understand.
|
||
- The ending reaches a musical landing or forms a deliberate loop.
|
||
|
||
For direct timing control, use the [Studio timeline](/studio/timeline) to refine
|
||
cuts, holds, and the ending against the beat markers. Ask the agent when the
|
||
section, media plan, or overall treatment must change.
|
||
|
||
<Card title="Finish and share" icon="circle-check" href="/guides/export-and-share">
|
||
Check the final project, render through your preferred surface, and review the file.
|
||
</Card>
|
||
|
||
## Related topics
|
||
|
||
- [Edit cuts and holds on the Studio timeline](/studio/timeline)
|
||
- [Work with voice, music, sound, and captions](/guides/voice-and-audio)
|
||
- [Prompt for music videos and slideshows](/prompting/music-and-slideshows)
|