mirror of
https://github.com/heygen-com/hyperframes.git
synced 2026-08-31 02:41:44 +00:00
* ci: bound the ffmpeg apt fetch so a stalled mirror costs a retry, not the job Hosted runners intermittently stall on an apt mirror, and an unbounded apt-get inherits the whole job budget. The producer integration lane normally finishes in ~11 minutes against a 20 minute cap; on a stalled fetch it ran to the cap and failed. Same step, same shape, reproduces on main's tip — it is not specific to any one PR. The cost is not one red check. On the run that prompted this, four went red off that single step: the two jobs that install ffmpeg, plus a Test gate and a preview-regression gate that both fail closed when their dependency does not succeed. So a mirror stall reads as a producer defect and a preview defect. Each attempt is now bounded and retried three times, and the five workflows that installed ffmpeg share one action instead of five copies of the command. Deliberately still apt: caching the binary would strip it from the shared libraries it links against, and switching to a static build would change the ffmpeg under the producer's output comparisons. Neither belongs in a fix for a network stall. * ci: drop the stray version echo left in the player-perf ffmpeg step Converting the step to the shared action left the trailing `ffmpeg -version` line behind, and YAML folded it into the `uses:` value — so the runner looked for an action at a path with the command appended and failed all four perf shards. It parsed cleanly, which is why validating with a YAML load did not catch it: `uses: ./path\n ffmpeg -version` is a legal folded scalar. The check that does catch it asserts every local `uses:` resolves to a directory containing an action file, which is now what I ran. The action prints the version itself. * ci: bound the ffmpeg fetch at the connection, not with a wall-clock kill The first version wrapped apt in `timeout` and retried. A passing run showed why that is the wrong shape: the mirror is slow rather than hung — the install spent ~15 minutes pulling packages from azure.archive.ubuntu.com and finished successfully. Killing it at 300s discarded a download that was making progress and started over, so the retry turned a slow mirror into a slower one, and the worst case of three attempts exceeded the job's own 20 minute cap. Bound the connection instead. Acquire::Retries re-fetches the one package whose connection stalled while keeping everything already downloaded, and Acquire::http::Timeout caps how long any single connection may sit idle. That addresses the stall the original report described without punishing the slow case that is far more common.
128 lines
4.7 KiB
YAML
128 lines
4.7 KiB
YAML
name: Catalog Previews
|
|
|
|
permissions:
|
|
contents: read
|
|
|
|
# Suppress hyperframes CLI telemetry from HeyGen's own CI runs.
|
|
# External users' CI continues to emit telemetry unless they set this themselves.
|
|
env:
|
|
HYPERFRAMES_NO_TELEMETRY: "1"
|
|
|
|
on:
|
|
pull_request:
|
|
branches: [main]
|
|
paths:
|
|
- "registry/blocks/**"
|
|
- "registry/components/**"
|
|
- "scripts/generate-catalog-previews.ts"
|
|
# Modules the renderer imports. Without them a change to path-traversal
|
|
# defence or temp-directory allocation alone never re-runs the job that
|
|
# exercises it.
|
|
- "scripts/registry-target-paths.mjs"
|
|
- "scripts/catalog-preview-temp.ts"
|
|
- ".github/workflows/catalog-previews.yml"
|
|
|
|
concurrency:
|
|
group: catalog-previews-${{ github.ref }}
|
|
cancel-in-progress: true
|
|
|
|
jobs:
|
|
preflight:
|
|
name: Preflight (lint + format)
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 5
|
|
steps:
|
|
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
|
|
- uses: ./.github/actions/preflight
|
|
|
|
render-previews:
|
|
name: Render catalog previews
|
|
needs: preflight
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 30
|
|
steps:
|
|
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
|
|
with:
|
|
fetch-depth: 0
|
|
|
|
- uses: oven-sh/setup-bun@0c5077e51419868618aeaa5fe8019c62421857d6 # v2
|
|
|
|
- uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
|
|
with:
|
|
node-version: 22
|
|
|
|
- run: bun install --frozen-lockfile
|
|
|
|
- run: bun run build
|
|
|
|
# Chrome headless shell for rendering
|
|
- uses: browser-actions/setup-chrome@c785b87e244131f27c9f19c1a33e2ead956ab7ce # v1
|
|
with:
|
|
chrome-version: stable
|
|
|
|
# The renderer shells out to ffmpeg for both halves of a preview: the
|
|
# poster transcode and the web encode of the mp4. Neither ran here before
|
|
# (`--skip-video` skipped the encode, and the poster copy was a plain
|
|
# file copy), so the job never needed it and ubuntu-latest does not ship
|
|
# it.
|
|
- name: Install ffmpeg
|
|
uses: ./.github/actions/install-ffmpeg-linux
|
|
|
|
- name: Render changed block/component previews
|
|
env:
|
|
BASE_SHA: ${{ github.event.pull_request.base.sha }}
|
|
run: |
|
|
# Find which blocks/components changed in this PR. The trailing slash
|
|
# in the grep matters: an item is a directory, and a file sitting
|
|
# directly under registry/components (CATALOG.md) does not match the
|
|
# sed, so without it the whole path survives and is passed to the
|
|
# renderer as if it were an item name.
|
|
CHANGED_ITEMS=$(git diff --name-only --diff-filter=ACMR "$BASE_SHA"...HEAD -- registry/blocks/ registry/components/ \
|
|
| grep -E '^registry/(blocks|components)/[^/]+/' \
|
|
| sed 's|^registry/[^/]*/\([^/]*\)/.*|\1|' \
|
|
| sort -u)
|
|
|
|
# A renderer change reaches every item, so it cannot be trusted to a
|
|
# PR that happens to also touch a block. Two canaries cover the two
|
|
# shapes the renderer has to tell apart: a block whose scene lives in
|
|
# a <template> (mounted through a wrapper) and one that registers its
|
|
# timeline at body level (rendered directly). Getting that wrong is
|
|
# silent — the wrong-shaped block renders blank, not red.
|
|
RENDERER_CHANGED=$(git diff --name-only --diff-filter=ACMR "$BASE_SHA"...HEAD \
|
|
-- scripts/generate-catalog-previews.ts scripts/registry-target-paths.mjs \
|
|
scripts/catalog-preview-temp.ts)
|
|
if [ -n "$RENDERER_CHANGED" ]; then
|
|
CHANGED_ITEMS=$(printf '%s\n' $CHANGED_ITEMS \
|
|
code-snippet-visual-studio-dark code-snippet-apple-terminal-pro | sort -u)
|
|
fi
|
|
|
|
if [ -z "$CHANGED_ITEMS" ]; then
|
|
echo "No block/component changes detected."
|
|
exit 0
|
|
fi
|
|
|
|
echo "Changed items: $CHANGED_ITEMS"
|
|
FAILED=0
|
|
|
|
for item in $CHANGED_ITEMS; do
|
|
echo "Rendering preview for: $item"
|
|
if ! timeout 120 npx tsx scripts/generate-catalog-previews.ts --only "$item" --skip-video; then
|
|
echo "::warning::Failed to render preview for $item"
|
|
FAILED=$((FAILED + 1))
|
|
fi
|
|
done
|
|
|
|
if [ "$FAILED" -gt 0 ]; then
|
|
echo "::warning::$FAILED item(s) failed to render"
|
|
exit 1
|
|
fi
|
|
|
|
- name: Upload preview artifacts
|
|
if: always()
|
|
uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4
|
|
with:
|
|
name: catalog-previews
|
|
path: docs/images/catalog/
|
|
if-no-files-found: ignore
|
|
retention-days: 7
|