Patterns

UnlabeledVideo -> List<HighUncertaintyFrame>

Select video frames with the highest model tracking uncertainty to prioritize for manual human annotation.

Image -> List<PoseKeypoints>

Detect all candidate keypoints globally across an image and group them into distinct instances using spatial affinity scores.

Image -> List<PoseKeypoints>

Detect individual object bounding boxes first, then estimate keypoints inside each isolated bounding box.

TargetedDOMNode -> UIComponentSpec

Extract clean HTML DOM subtrees, calculated bounding boxes, and computed CSS variables from an element to reconstruct it as a modular component.

BrowserRuntimeState -> PromptContext

Inject live browser console logs and debugger stack traces into an LLM context window to guide troubleshooting.

Stream<ChatMessage> -> Stream<ArtifactState>

Parse structured code or document blocks from a chat stream to display them in an interactive, persistent workspace panel.

TaskPrompt -> List<SubAgentResult>

Decompose a complex parent prompt into parallel child-agent subtasks and aggregate their outputs back into the primary thread.

BoundingBoxes + ViewportDimensions -> ViewportTransform

Calculate and apply scaling and translation transformations on a workspace matrix to fit the bounding rectangle of all elements within container view boundaries.

RelationshipConfig + ElementCoordinates -> ConnectorPath

Resolve visual connections dynamically between elements by targeting their unique DOM identifier attributes to compute relative coordinate vectors.

ComponentTemplate + NodeData -> RenderedNode

Delegate graph node visual rendering to user-defined component templates mapped dynamically to node state.

RawTranscription -> RichTranscription

Parse and structure metadata tags (e.g., laughter, coughing, bgm) from the raw model-generated token sequence into user-friendly text.

(AudioSignal, Text) -> TranscriptWithTimestamps

Align generated textual tokens to precise audio time intervals using connectionist temporal classification boundary mappings.

UserQuery -> MCPToolPayload

Expose catalog schema registry queries as callable tools via the Model Context Protocol.

Map<EntityID, RelationshipYAML> -> GraphVisualizationData

Generate node-link architectural graphs directly from parsed domain, service, and message YAML frontmatter.

ShortPrompt -> DenseStructuredPrompt

Expand short scene descriptions into dense, structured, spatial-temporally rich prompts using an LLM prior to video/image generation.

Tensor[Tokens] -> Tensor[PositionEncodedTokens]

Encode spatial, temporal, and modal structures by applying a unified 3D rotary position embedding to mixed-modality tokens.

MultimodalTokens -> MultimodalTokens

Route reasoning tasks through causal self-attention and multimodal generation tasks through full-attention denoising within a shared transformer backbone.

Audio -> TranscriptWithSpeakerLabels

Segment audio using voice activity detection (FSMN-VAD), extract speaker embeddings via verification models (CAM++), transcribe audio with ASR, and align outputs to produce punctuated, speaker-attributed transcripts.

(Text, List<AudioSegment>) -> List<AudioToken>

Interleave tokenized text segments with discrete quantized audio segments to condition speech generation on conversational history.

FrameEmbedding -> List<QuantizedToken>

Predict high-order audio codebooks autoregressively within each frame using a small decoder conditioned on a base frame embedding.

TargetAgent -> DialogHistory

Simulate an adversarial dialogue loop between an attacker LLM agent and a target LLM agent to test resistance to multi-step manipulation.

PromptResponsePair -> EvaluationReport

Evaluate model responses against safety, privacy, or security rules using an LLM judge to produce a binary violation score and reasoning.