Collected sources and patterns will appear here. Add from search, explore, or the patterns library.
SourceConfig -> Stream<Record>
Read from a static directory path for batch processing or transition to polling/watching the same directory for streaming updates without modifying consumer logic.
Problem it solves
Supporting both historical backfills and live real-time streams requires duplicating ingestion logic.
Consumes
Emits
The real projects this mechanism was found in. Attribution is the point — this is how the best teams actually do it.