Measuring agents, not vibes

November 2, 4:35 PM–5:00 PM (PST) • Room 1

Every team is shipping agents. Almost nobody can tell you if they work. Page views and funnels were built for humans clicking buttons, and they break when the user is a model making hundreds of decisions per task. This talk covers the signals that actually predict agent success (task completion, retries, human overrides, cost per outcome) and how to capture and query them at scale without drowning in traces.

OSA CON logo

Join OSA Con 2026

The anti-hype conference for open-source analytics and AI. Connect with engineers, maintainers, and technology leaders building the future of data.

November 2, 2026
San Francisco + Online

Register