* feat(audio): composition master bus (data-fx-chain on the root) A clip can belong to only one audio group, so there was no way to put one effect, such as a limiter, across the whole mix. The data-fx-chain on the top-level composition root now runs once over the sum of every clip and every group, after each group's own chain and fader. No new attribute: a sub-composition root's data-fx-chain was never applied to anything and still is not. Render: when a master chain exists, mixAudioTracks writes a float WAV instead of AAC, applyAudioFxChain runs the chain over it, and ffmpeg encodes AAC last, so the chain reads unclipped samples. An unreadable chain is a mix failure, as for a group. Preview: the transport splices the chain between the clips' sum and the monitor, re-anchored per play generation and watched for edits. Only the top-level root is read. No master automation: the root's data-automation is not read as the bus's. No lint rule: data-fx-chain is valid on clips, groups and roots, and the one place it does nothing (a sub-composition root) has always been silent. — Jerrai * fix(core): preview routes every audible video through the master bus A root data-fx-chain is attached only inside the Web Audio graph, but a plainly audible <video> joined that graph only for its own chain, group, automation or a volume over 1. So preview limited the music and left the talking head dry, and a composition whose only audio is video got no master chain at all, while export sums every audible element into the master. A master chain on the top-level composition root is now a reason to join, the same as a video's own chain. Elements under a root with no chain keep native output. Sub-composition roots are still ignored. — Jerrai * fix(audio): master bus review round 2 (temp dir, tests, docs, Studio meter) - audioMixer: a fatal FX error in the master pass or a group bus left the work directory (the full float sum, about 1.4 GB an hour) on disk. The final mix now runs in try/finally and the group rethrow removes it first. - Tests: the "once over the sum" case now uses a limiter then a gain, so a per-clip chain (-10.4) and a doubled one (-18) both fail it; a new case proves the sum stays float until the chain reads it; the fader case uses a group volume of 0.5 so the fader's position is exercised; the work-dir removal is covered for both paths. - Docs: "Three rules exist" (the master-bus lint rule is gone), a bad master chain stops the render with audio_processing_failed, a sub-composition file opened on its own has its root chain as the master bus, and a seek clears a group or master limiter. - Studio: TimelineElement.masterChain carries the root's data-fx-chain, so the program meter shows for a video-only composition whose only audio routing is the master chain, as preview now plays it. - Comment blocks over four lines cut; webAudioTransport.setRate split so its CRAP score is under the Fallow threshold. — Jerrai * fix(audio): master chain reaches tracks the render adds; honest plain-limiter copy - Master chain: it was carried on each parsed AudioElement, so a track the producer adds itself (appendAutoDetectedVideoAudio, the browser-discovered audio in probeStage) never had it, and a composition whose only audio was such a track exported with no master chain, no ceiling and no warning. It is now a composition property: parseMasterFxChain(html) at compile, carried on CompiledComposition and CompositionMetadata, passed to processCompositionAudio by runAudioStage (in-process and distributed plan). AudioElement.masterFxChain is removed so there is one source. Each forward (compile stage, local orchestrator, distributed plan) has a test that fails when it is dropped. - Plain limiter: it follows the level with no lookahead and Level after is applied past the ceiling, so it cannot promise "nothing gets past" or "never clips". Studio copy (description, panel text, knob label, summary) and the hyperframes-audio skill now say a fast or inter-sample peak can pass it and point to the true-peak limiter for a delivery limit. A copy test guards it. — Jerrai * fix(producer): keep master bus comments within the ratchet; run the plan test with the ffmpeg tests Drop three one-line field comments that raised their files' comment share, and list plan.masterBus.test.ts with the integration tests because plan() reads the ffmpeg version. — Jerrai * chore(ci): repin the producer test-classification source in the reachability map The reachability map pins the hash of test-classification.mjs, which now lists one more integration test. The map's producer lane command already covers every test under src, in both the unit and integration matrix lanes. — Jerrai
6.5 KiB
The three audio attributes
All three go on the <audio> / <video> element itself, JSON-encoded, so a
composition carries its whole mix in the HTML with nothing to load beside it.
data-fx-chain and data-automation also go on an <hf-audio-group> bus,
where they mean the same thing over the summed members — with one difference
worth knowing: a group's automation runs on COMPOSITION time, since a bus has no
data-start of its own. data-fx-carve is clip-only; a bus has no carve.
Nothing static validates them: preview plays an unreadable chain dry to stay
workable, and the render refuses the whole mix rather than shipping a dry track
that sounds plausible and is wrong.
data-fx-chain — the effects
{
"version": 1,
"nodes": [
{
"type": "highpass",
"id": "n1",
"label": "Remove Rumble",
"params": { "frequency": 120, "q": 0.707, "poles": "2" }
},
{
"type": "peaking",
"id": "n2",
"fromCarve": true,
"params": { "frequency": 1600, "gain": -6, "q": 1.4 }
},
{
"type": "limiter",
"id": "n3",
"enabled": false,
"params": { "limit": -1, "attack": 5, "release": 50, "level_out": 0 }
}
]
}
Write these attributes double-quoted, with the JSON's own quotes as ".
The browser reads them through getAttribute and does not care, but
scripts/carve.mjs finds them with a name="..." regex, so a single-quoted
attribute is invisible to it — the carve reports no existing chain and quietly
overwrites work it could not see. & becomes &; nothing else needs
escaping.
- Order is signal order. Each node processes what the one before produced.
typeis an effect id from the registry.paramsare in the units a person thinks in — dB, ms, Hz — and out-of-range values are clamped on read, so a chain that parses is always safe to realise.idis a stable handle. Automation addresses nodes by id, never by position, so reordering the chain cannot re-point a lane at a different effect. A node with no id loads fine but cannot be automated. Writing a chain by hand, any unique string works; Studio hands out the first freen1,n2, … so matching that convention keeps a hand-written chain and an edited one looking alike.labelis what the rack calls this node, replacing the effect's own name. Write one whenever the node is doing a named job — a chain with twopeakingnodes otherwise shows the same row twice and the author cannot tell which is the mud cut and which is the clarity lift. Presets and jobs always set it; a hand-written node should too. Seepresets.mdfor the names they use.enabled: falseis bypass — the node stays in the chain, out of the signal path. Absent means enabled.fromCarve: truemarks a node the carve analysis generated. Re-running the carve replaces exactly these and leaves hand-built effects alone. Do not set it by hand: a node tagged this way will be deleted by the next carve.
data-automation — the envelopes
{
"version": 1,
"lanes": [
{
"target": "volume",
"points": [
{ "t": 0, "v": 1 },
{ "t": 2.5, "v": 0.4 }
]
},
{
"target": "fx.n2.gain",
"points": [
{ "t": 0, "v": 0 },
{ "t": 1, "v": -6, "curve": 0.4 }
]
}
]
}
targetisvolumefor the track's own level, orfx.<nodeId>.<param>.tis seconds from the start of the clip, not of the composition. A bed starting atdata-start="8"hast: 0at composition time 8.vis in the parameter's own unit: dB for a gain, Hz for a frequency, 0..1 for volume.- A lane holds its first value backwards to the start of its clip and its last
value forward to the end. So a bed that begins before the voice needs an
explicit "no cut" point at
t: 0, or it starts out already ducked. curve(-1..1) bends the segment leaving a point: positive holds low then rises late.viaX/viaYname an interior point the segment passes through (progress 0..1, value travelled 0..1) and supersedecurvewhen both are present — that is what the timeline writes when a bend is dragged.- 512 points per lane, maximum.
- A lane whose node is gone is pruned on read rather than erroring.
A lane on a non-automatable parameter is silently inert. Automation is
delivered as native AudioParam scheduling, so a knob that no AudioParam backs
cannot move: worklet processor options, a WaveShaper curve and a convolution
impulse are all set wholesale. fx-registry.md marks each parameter; the
worklet effects (compressor, limiter, truepeak, gate, bitcrush) have none at all.
data-fx-chain on the root — the master bus
The data-fx-chain JSON on the top-level composition root (the element with
data-composition-id that no other composition contains) is the master bus. It
runs once over the sum of every clip and group, after each group's own chain and
fader. On a clip or a group data-fx-chain keeps its own meaning, and on a
sub-composition root inside a parent composition it is not applied. The master bus has no
automation lanes.
data-fx-carve — the carve's settings
{ "enabled": true, "sources": ["narration", "interview-guest"], "strength": 0.35 }
sourcesare the element ids of every voice this bed makes room for. They live on the bed being processed, not on the voices. Summed onto the bed's clock before the analysis, so one set of filters and envelopes covers all of them.strength0..1 derives the whole mechanism (seecarveProfile).- There is no
dynamic: a carve always follows the speech. enabledis whether the carve applies. It exists because a bed with exactly one candidate voice is carved by default: with "off" represented by an absent attribute, switching it off would read as never-configured and the default would put it back.enabled: falsekeeps the settings and stops the carve.
This attribute is not read at playback — the chain and lanes it produced are what play. It exists so the settings can be read back and re-derived rather than guessed from the filters, which is what makes changing strength on an existing carve possible.
Older projects may carry the six mechanism numbers (maxCutDb, bands, q,
intelligibilityBias, duckDb, headroomDb) instead of strength. They still
load: the depth maps back onto a strength and everything else is re-derived. A
stored carve with no enabled reads as on, and a single source reads as a one-voice
sources list. A stored dynamic is ignored — every carve follows the speech now.