Real-time LLM performance tracking and latency monitoring.
Avg
503.0ms
Min
503ms
Max
406.0ms
406ms
446.0ms
446ms