Changelog

What we shipped

New features, improvements and fixes, every two weeks.

v3.0

Replay: re-run production traces against a new prompt

Pick any set of traces, change the prompt, model or temperature, and run them again. Tool responses are served from the recording, so replays never call Stripe, your CRM or your customers. Every evaluator is scored on both versions and shown side by side.

When a customer reports a duplicate charge:
- Refund the most recent charge.
+ Call stripe.list_refunds first. If a refund exists, say when it arrives.
412 traces replayedPolicy 0.72 → 0.91Cost $3.18

Replay is available on Team and Enterprise. Read the guide →

  • ImprovedTrace search is 3× faster on workspaces with more than 100M spans.
  • FixedStreaming spans from the Vercel AI SDK no longer show a duplicate first token.
v2.14

Command menu

Press ⌘ K anywhere to jump to a trace, an agent, a dataset or a setting. Paste a trace ID to open it directly.

refund
Agents
Arefund-agent↵
Datasets
refund-edge-cases · 412 traces
refund-duplicates · 96 traces
Actions
Create guardrail for refund-agent
  • NewKeyboard shortcuts: J/K to move between spans, E to expand all.
  • ImprovedToken counts now show cached and uncached input separately.
v2.13

Judge calibration

Label a sample of traces yourself and see how often each LLM judge agrees with you. Sightline reports agreement, Cohen’s κ and a confusion matrix, and links every disagreement back to its trace.

  • NewInvite reviewers who only have access to labelling, not to raw traces.
  • FixedEval scores on retried spans are no longer counted twice.
  • FixedThe cost chart now respects the workspace time zone.
v2.12

EU data residency

Enterprise workspaces can now store all trace data in Frankfurt. Existing workspaces can migrate from the settings page with no downtime.

  • ImprovedThe Python SDK adds under 0.4ms of overhead per span, down from 1.1ms.