Glossary
/
Performance

Latency

How long an AI agent takes to respond.

Definition

Latency is how long an AI agent takes to respond. It matters most for voice, where a reply has to arrive in under about 800 milliseconds to feel natural. Fast data lookup, for example a knowledge graph lookup under 200ms, leaves the model time to think and still answer quickly.

Key points

<ul><li>Slow retrieval (searching many documents or running several database queries) adds delay.</li><li>A knowledge graph answers in one pass instead of five separate queries, which keeps latency low.</li></ul>