Node Queue Worker

Recommended Pattern

Throughput Tuning

• Adjust concurrency per model type.
• Prioritize short jobs for better user latency.
• Separate high-priority and bulk queues.

Operational Patterns

• Use queue-based orchestration for sustained throughput.
• Separate latency-sensitive traffic from bulk processing workloads.
• Centralize webhook/event consumption through one idempotent handler.
• Use dead-letter queue for repeated failures and manual replay.

Go-Live Checklist

1. Load test with realistic clip duration distribution.
2. Validate alerting for error rate, queue lag, and failed jobs.
3. Confirm credit accounting and billing UX alignment.
4. Prepare escalation template containing job_id + payload summary.

Node Worker Observability

• Emit per-job lifecycle events to centralized logging.
• Track retry counts and dead-letter frequency.
• Expose queue depth and processing latency metrics.