{"version":1,"type":"rich","provider_name":"Libsyn","provider_url":"https:\/\/www.libsyn.com","height":300,"width":600,"title":"Automate evaluations | Microsoft Foundry","description":"Build AI agents that meet your standards for quality, safety, and performance using Microsoft Foundry. Trace every run end-to-end, generate synthetic datasets to stress-test on demand, fire automated Red Team attacks at your own agents, and pin down why evaluations fail \u2014 all from the Microsoft Foundry control plane. Lock in guardrails that inspect every tool call at runtime, define the risks once, and enforce them across every agent run. Mohammad Abuomar, Responsible AI Principal Architect, shares how to turn a coding agent into production-ready software inside Foundry. \u25ba QUICK LINKS: 00:00 - Microsoft Foundry control plane 00:33 - See a finished agent 02:30 - See where the agent started 03:19 - Traces 04:04 - Built-in monitoring 04:34 - Evaluation types 05:51 - Red team evaluations 07:08 - Evaluation results 08:14 - Built-in Guardrails 08:14 - Wrap up \u25ba Link References Get everything you need in Microsoft Foundry at https:\/\/ai.azure.com \u25ba Unfamiliar with Microsoft Mechanics? As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft. \u2022 Subscribe to our YouTube: https:\/\/www.youtube.com\/c\/MicrosoftMechanicsSeries \u2022 Talk with other IT Pros, join us on the Microsoft Tech Community:  https:\/\/techcommunity.microsoft.com\/t5\/microsoft-mechanics-blog\/bg-p\/MicrosoftMechanicsBlog \u2022 Watch or listen from anywhere, subscribe to our podcast: https:\/\/microsoftmechanics.libsyn.com\/podcast \u25ba Keep getting this insider knowledge, join us on social: \u2022 Follow us on Twitter: https:\/\/twitter.com\/MSFTMechanics \u2022 Share knowledge on LinkedIn: https:\/\/www.linkedin.com\/company\/microsoft-mechanics\/ \u2022 Enjoy us on Instagram: https:\/\/www.instagram.com\/msftmechanics\/ \u2022 Loosen up with us on TikTok: https:\/\/www.tiktok.com\/@msftmechanics ","author_name":"Microsoft Mechanics Podcast","author_url":"http:\/\/microsoftmechanics.libsyn.com\/podcast","html":"<iframe title=\"Libsyn Player\" style=\"border: none\" src=\"\/\/html5-player.libsyn.com\/embed\/episode\/id\/41372125\/height\/300\/theme\/custom\/thumbnail\/yes\/direction\/forward\/render-playlist\/no\/custom-color\/2576bb\/\" height=\"300\" width=\"600\" scrolling=\"no\"  allowfullscreen webkitallowfullscreen mozallowfullscreen oallowfullscreen msallowfullscreen><\/iframe>","thumbnail_url":"https:\/\/assets.libsyn.com\/secure\/content\/202175985"}