mirror of
https://github.com/heygen-com/hyperframes.git
synced 2026-09-03 04:38:33 +00:00
ukimsanov
ad4c6a9b6e
**Nine guide videos rebuilt in the light house style.** They were dark — a reader clicking between sibling guides watched the theme flip. mcp, performance, rendering, skills, html-in-canvas and remove-background were restyled to the bone field; faceless-explainer, product-launch and voice-and-audio were re-narrated with River, the house voice the user-journey films use. Measured luma is 177-230, matching the journey films, and every one carries audio. The restyle also surfaced a real bug in the frame itself: the house coral #D96A4F is 2.95:1 on bone, under the WCAG large-text floor, and `hyperframes check` failed on it. Darkened to #B44E33 (4.43:1) before any of these rendered. **canary-rollouts trimmed from 2,443 words to 520.** The statistical-calibration essay — pre-registered experiment design, a probability formula, rejected hardware-fingerprinting alternatives — was never documentation for someone shipping a staged rollout. Cut to Add one / Override one / Remove one / Where it lives, the part that was already good. **thirty-days now shows the films.** It was 431 words and 30 links to x.com for a series entirely about videos, with no thumbnails. It now leads with real preview clips where a film exists and marks the rest with a visual placeholder rather than a dead off-site link.
130 lines
5.0 KiB
Plaintext
130 lines
5.0 KiB
Plaintext
---
|
|
title: "Use voice, music, sound, and captions"
|
|
sidebarTitle: "Voice, sound, and captions"
|
|
description: "Build an understandable audio mix, transcribe real speech, and turn it into readable captions."
|
|
---
|
|
|
|
import { DocsVideo } from "/snippets/docs-video.jsx";
|
|
|
|
Give each audio layer one job. Add another layer only when it helps the viewer
|
|
understand or feel the video.
|
|
|
|
| Layer | Main job |
|
|
| ------------- | --------------------------------------------------- |
|
|
| Voiceover | Carry the explanation or story |
|
|
| Source audio | Preserve speech or sound from existing footage |
|
|
| Music | Shape pace, tone, and structure |
|
|
| Sound effects | Reinforce a specific action or transition |
|
|
| Captions | Make spoken words readable and searchable on screen |
|
|
|
|
|
|
<DocsVideo
|
|
title="Narration, music ducking under it, and effects landing on the beat"
|
|
src="https://static.heygen.ai/hyperframes-oss/docs/images/showcase/voice-audio-demo-v2.mp4"
|
|
poster="https://static.heygen.ai/hyperframes-oss/docs/images/showcase/voice-audio-demo-v2.jpg"
|
|
/>
|
|
|
|
Turn the sound on for this one — the audio is the subject. You can watch the
|
|
music duck as narration arrives and see each effect land against the waveform.
|
|
|
|
## Create a voiceover
|
|
|
|
Give the agent the approved wording and useful voice direction:
|
|
|
|
```text
|
|
Generate the approved SCRIPT.md as a warm, direct voiceover.
|
|
Natural pace, no announcer energy. Keep the product-name pronunciation exact.
|
|
```
|
|
|
|
The project can keep the script, audio, and word-level transcript separately.
|
|
That lets you regenerate the voice without discarding the timing and caption
|
|
work around it.
|
|
|
|
Listen before building the final edit. Fix wording, pronunciation, or delivery
|
|
in the script or voice direction rather than cutting around a bad read.
|
|
|
|
## Transcribe recorded speech
|
|
|
|
Transcription creates timed words from an audio or video file. Start with the
|
|
automatic engine: it uses Parakeet when installed and falls back to Whisper.
|
|
|
|
```bash
|
|
npx hyperframes transcribe interview.mp4
|
|
```
|
|
|
|
Pass the spoken language when you know it. This filters non-target speech and
|
|
lets the Whisper fallback choose a multilingual model when needed.
|
|
|
|
```bash
|
|
npx hyperframes transcribe interview.mp4 --language es
|
|
```
|
|
|
|
For difficult English audio, force the larger English Whisper model. For an
|
|
unknown language, use multilingual `large-v3` and let Whisper detect it.
|
|
|
|
```bash
|
|
npx hyperframes transcribe interview.mp4 --engine whisper --model medium.en
|
|
npx hyperframes transcribe interview.mp4 --engine whisper --model large-v3
|
|
```
|
|
|
|
Larger models take longer and do not remove the need to read the result.
|
|
|
|
The command can also import an existing `.srt`, `.vtt`, or supported transcript
|
|
JSON file:
|
|
|
|
```bash
|
|
npx hyperframes transcribe subtitles.srt
|
|
```
|
|
|
|
## Turn the transcript into captions
|
|
|
|
1. Read the complete transcript.
|
|
2. Correct names, product terms, numbers, punctuation, and obvious recognition
|
|
errors.
|
|
3. Group words into short phrases that break on meaning.
|
|
4. Open [Captions in Studio](/studio/captions) to inspect the rhythm and adjust
|
|
placement, scale, or rotation. Make durable wording, timing, style, and
|
|
animation changes in the caption source or ask the agent to update it.
|
|
5. Watch once with sound for synchronization and once muted for readability.
|
|
|
|
Captions should follow what was said. They should not cover a face, product
|
|
control, or another important visual. Use emphasis on the few words that carry
|
|
the point instead of making every word compete.
|
|
|
|
For an existing talking-head clip, use [Captions or
|
|
recuts](/guides/captions-and-recuts) to choose between plain captions, designed
|
|
graphic overlays, and an actual change to the spoken edit.
|
|
|
|
## Mix for understanding
|
|
|
|
- Keep voice clear above music.
|
|
- Duck music under important speech instead of reducing the whole track
|
|
equally.
|
|
- Use sound effects for meaningful events, not every movement.
|
|
- Avoid cutting words, breaths, or reverb tails accidentally at scene
|
|
boundaries.
|
|
- Let a deliberate silence remain silent.
|
|
- Listen on ordinary headphones and laptop speakers.
|
|
|
|
When narration drives the project, time visual changes to its real transcript
|
|
rather than estimated scene lengths. When music drives the project, use the
|
|
[music-video workflow](/guides/music-to-video) and its analyzed structure.
|
|
|
|
## Review the complete sound pass
|
|
|
|
- The correct voice and source recordings are used.
|
|
- Names, claims, and captions are accurate.
|
|
- Speech stays clear through the loudest musical section.
|
|
- Effects arrive with the action they support.
|
|
- The opening does not surprise the listener with excessive volume.
|
|
- Music and ambience finish intentionally instead of stopping at the file edge.
|
|
|
|
Render a review file and listen without watching once. Audio problems are often
|
|
easier to notice when the visuals are not competing for attention.
|
|
|
|
## Related topics
|
|
|
|
- [Add captions or repackage talking-head footage](/guides/captions-and-recuts)
|
|
- [Edit captions in Studio](/studio/captions)
|
|
- [Finish, render, and share](/guides/export-and-share)
|