Collected sources and patterns will appear here. Add from search, explore, or the patterns library.
Stream<Request> -> Stream<BatchRequest>
Merge concurrent incoming asynchronous requests into a single batch based on latency and max-batch-size thresholds before executing a target handler.
Problem it solves
Deep learning models run more efficiently on batches, but clients submit requests asynchronously.
Consumes
Emits
The real projects this mechanism was found in. Attribution is the point — this is how the best teams actually do it.