Collected sources and patterns will appear here. Add from search or the patterns library.
Queue<Input> -> Queue<Output>
Execute independent cascading stages of an audio/text pipeline on separate threads connected by thread-safe queues to ensure non-blocking, low-latency processing.
Problem it solves
Sequential blocking executions of CPU-heavy and GPU-heavy tasks (VAD, STT, LLM, TTS) on a single thread cause high audio streaming latency.
Consumes
Emits
The real projects this mechanism was found in. Attribution is the point — this is how the best teams actually do it.