Model behavior and API integration

All topics · Alphabetical index

Concepts

• Tokens; tokenization; input token budget; output token budget; context window
• Model capabilities; modalities; capability detection; provider compatibility
• Model selection; routing; fallback; escalation; version pinning; model migrations
• Instruction hierarchy; instruction following; nondeterminism; reproducibility limits
• Sampling; temperature; top-p; stop sequences; reasoning effort; inference budgets
• Structured outputs; tool calls; final responses; refusals; truncation
• Streaming events; partial responses; completion status; cancellation
• Timeouts; retries; quotas; rate limits; ambiguous outcomes
• Model confidence; factual correctness; knowledge cutoff; retrieved evidence

Further reading

Reference links for this topic.

• OpenAI agent engineering resources