For feature details, visit Whova
ABOUT THE SPEAKER:
Wendy is a principal data scientist at Disco, a Toronto based educational technology startup. She has over a decade of experience building data products and teams at scale. Previously, she has held data leadership positions at Shopify, PagerDuty, and Wattpad.
TALK TITLE:
TRACK:
SUB TOPIC:
ABSTRACT:
Disco’s MCP server lets learning operators and administrators manage and generate insight about their programs through AI agents instead of dashboards, which means those agents need to be trustworthy, not just capable. This talk walks through how we built our eval process for MCP tools, from defining what ‘correct’ looks like for operator-facing actions to structuring a dataset that catches failures before operators do.
WHAT YOU’LL LEARN:
Most organizations building on MCP are still treating it like a plumbing problem (get the tools connected, ship it) without a rigorous way to know whether the agent is actually doing the right thing when it touches real operator data and workflows. This talk gives practitioners a concrete, repeatable process for building evals that catch agent failures before they reach production, using a real multi-phase MCP rollout as the case study.
Business Leaders: C-Level Executives, Project Managers, and Product Owners will get to explore best practices, methodologies, principles, and practices for achieving ROI.
Engineers, Researchers, Data Practitioners: Will get a better understanding of the challenges, solutions, and ideas being offered via breakouts & workshops on Natural Language Processing, Neural Nets, Reinforcement Learning, Generative Adversarial Networks (GANs), Evolution Strategies, AutoML, and more.
Job Seekers: Will have the opportunity to network virtually and meet over 30+ Top Al Companies.
Ignite what is an Ignite Talk?
Ignite is an innovative and fast-paced style used to deliver a concise presentation.
During an Ignite Talk, presenters discuss their research using 20 image-centric slides which automatically advance every 15 seconds.
The result is a fun and engaging five-minute presentation.
You can see all our speakers and full agenda here