Skip to content

Multimodal application integration

All topics · Alphabetical index

Concepts

  • Image inputs; document inputs; audio inputs; video frames
  • OCR quality; layout understanding; image grounding
  • Speech recognition; text-to-speech; speech-to-speech
  • Voice activity detection; diarization; turn detection
  • Streaming transcription; barge-in; interruption handling
  • Word error rate; transcription latency; audio buffering
  • Realtime sessions; transport selection; session recovery
  • Multimodal prompt injection; consent; media retention

Further reading

Reference links for this topic.