Tuesday, September 29
Good morning, Priya
Agent runs+8.2%41,208
Eval pass rate+2.1 pts96.4%
p95 latency+0.4s5.8s
Cost per resolved ticket−$0.004$0.031
Runs and failures
RunsFailed evals
2.4k1.6k8000
10:14 · triage-router v8 deployed
00:0006:0012:0018:00now
Top failure causes
auto-clustered
Routes billing questions to salestriage-router · since v8 · 10:14
312runs
Claims refund sent after tool errorrefund-agent · tool_error_acknowledged
41runs
Cites outdated pricing articlekb-answerer · groundedness < 0.6
28runs
Repeated crm.lookup callstriage-router · loop breaker tripped
17runs
Replies in English to Spanish ticketskb-answerer · language_match
9runs
Agents
| Agent | Runs | Pass rate | p95 | Cost | Last 24h |
|---|---|---|---|---|---|
Rrefund-agentv13 | 8,412 | 97.8% | 5.1s | $212.40 | |
Ttriage-routerv8 | 21,930 | 91.2% | 1.9s | $96.10 | |
Kkb-answererv21 | 9,688 | 98.1% | 2.4s | $58.75 | |
Bbilling-syncpaused | 1,178 | 99.6% | 0.8s | $4.02 |
Guardrail activity
last 24h
Blocked refund of $2,340
refund-agent · waiting for approval from Grace L.
Loop stopped after 6 calls
triage-router · crm.lookup
Redacted 3 card numbers
kb-answerer · PII redaction