feat(producer): auto-size chunkSize from maxParallelChunks when undefined

mirror of https://github.com/heygen-com/hyperframes.git synced 2026-09-11 06:30:03 +00:00

Previously, plan() defaulted chunkSize to 240 on a `?? DEFAULT_CHUNK_SIZE`
line, so a 660-frame composition with maxParallelChunks=16 ended up at 3
chunks (ceil(660/240)) regardless of the caller's fan-out intent.

When config.chunkSize is undefined, auto-size from maxParallelChunks:
  effectiveChunkSize = max(MIN_CHUNK_SIZE, ceil(totalFrames / maxParallelChunks))

MIN_CHUNK_SIZE=10 keeps per-chunk fixed overhead from swamping the
parallelism gain on tiny renders. Explicit numbers, including 240, take
precedence over the auto-sizer — no behavior change for callers that set
chunkSize explicitly.

Surfaced by the lever-1 chunk-scaling benchmark on 2026-05-17.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

This commit is contained in:

James

2026-05-18 20:29:34 +00:00

co-authored by

Claude Opus 4.7

parent 27efcd0f80

commit e79a8faa42

3 changed files with 83 additions and 8 deletions

									
										packages/producer/src/distributed.ts
									
		+1
		
												View File
												
				@@ -44,6 +44,7 @@ export {

				  // Constants

				  DEFAULT_CHUNK_SIZE,

				  DEFAULT_MAX_PARALLEL_CHUNKS,

				  MIN_CHUNK_SIZE,

				  PLAN_DIR_SIZE_LIMIT_BYTES,

				  PLAN_PROJECT_DIR_SKIP_SEGMENTS,

				  // Error codes + classes