https://video.ut0pia.org/videos/watch/f680e649-d065-4866-b8b6-34dc52751dfc Across a dozen eval jobs Arize watches the top teams run, one pattern holds: the eval has to change as fast as the agent it grades. In 2023 an agent was barely more than a prompt; since then reasoning, tool calls, and long multi step loops piled on, and every jump in capability quietly broke the eval that came before. So the evals evolved with them. Deterministic checks catch what you can define up front, LLM as a judge adds the analysis a fixed rule cannot, and the newest step, agent as a judge, hunts for failure modes you would never think to write a check for and can open a pull request to fix what it finds. Aparna Dhinakaran's argument is that this arc, from static checks to an agent grading another agent, is where evals go next. Speaker info: https://x.com/aparnadhinak, https://www.linkedin.com/in/aparnadhinakaran/, Timestamps: 0:00 - Opening: the future of the Evals track 2:06 - Why evals got harder as agents evolved 3:45 - From deterministic checks to LLM as a judge 4:36 - Agent as a judge, and where evals go next Sat, 25 Jul 2026 21:48:29 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://video.ut0pia.org https://video.ut0pia.org/lazy-static/avatars/0287a09a-aae7-4840-9843-b416426e7046.webp https://video.ut0pia.org/videos/watch/f680e649-d065-4866-b8b6-34dc52751dfc All rights reserved, unless otherwise specified in the terms specified at https://video.ut0pia.org/about and potential licenses granted by each content's rightholder.