Judge the Judge: Building LLM Evaluators That Actually Work with GEPA

Judge the Judge: Building LLM Evaluators That Actually Work with GEPA — Mahmoud Mabrouk, Agenta AI https://video.ut0pia.org/videos/watch/9233abc6-7109-4ab4-a873-ecd3b2e24db3 Miscalibrated evals are worse than no evals. They give false confidence while being, at best, useless. This workshop walks you through building a calibrated LLM-as-a-judge, from capturing ground truth to optimizing with GEPA and assessing the judge. You will leave with an LLM-as-a-judge you can trust to actually improve your app. Mahmoud Mabrouk - Co-founder and CEO, Agenta AI Mahmoud Mabrouk is the cofounder and CEO of Agenta, an open-source LLMOps platform for building and evaluating LLM applications. He has spent the past 15 years working in machine learning and holds a PhD in applied machine learning for computational biology. Socials: https://x.com/mmabrouk_ https://www.linkedin.com/in/mmabrouk2/ https://agenta.ai https://github.com/agenta-ai/agenta Fri, 10 Apr 2026 16:27:46 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://video.ut0pia.org Judge the Judge: Building LLM Evaluators That Actually Work with GEPA — Mahmoud Mabrouk, Agenta AI https://video.ut0pia.org/lazy-static/avatars/0287a09a-aae7-4840-9843-b416426e7046.webp https://video.ut0pia.org/videos/watch/9233abc6-7109-4ab4-a873-ecd3b2e24db3 All rights reserved, unless otherwise specified in the terms specified at https://video.ut0pia.org/about and potential licenses granted by each content's rightholder.