29 min listen
How Microsoft Scales Testing and Safety for Generative AI with Sarah Bird - #691
FromThe TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
How Microsoft Scales Testing and Safety for Generative AI with Sarah Bird - #691
FromThe TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
ratings:
Length:
57 minutes
Released:
Jul 1, 2024
Format:
Podcast episode
Description
Today, we're joined by Sarah Bird, chief product officer of responsible AI at Microsoft. We discuss the testing and evaluation techniques Microsoft applies to ensure safe deployment and use of generative AI, large language models, and image generation. In our conversation, we explore the unique risks and challenges presented by generative AI, the balance between fairness and security concerns, the application of adaptive and layered defense strategies for rapid response to unforeseen AI behaviors, the importance of automated AI safety testing and evaluation alongside human judgment, and the implementation of red teaming and governance. Sarah also shares learnings from Microsoft's ‘Tay’ and ‘Bing Chat’ incidents along with her thoughts on the rapidly evolving GenAI landscape.
The complete show notes for this episode can be found at https://twimlai.com/go/691.
The complete show notes for this episode can be found at https://twimlai.com/go/691.
Released:
Jul 1, 2024
Format:
Podcast episode
Titles in the series (100)
This Week in ML & AI - 7/8/16: A BS Meter for AI, Retrieval Models for Chatbots & Predatory Robots: This Week in Machine Learning & AI brings you the… by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)