AI and MLOps with Kubernetes

In this episode, we caught up with Abdel Sghiouar, a Developer Advocate at Google and the co-host of The Kubernetes Podcast. Abdel shared the latest developments in Kubernetes and AI applications, highlighting the unique challenges of running machine learning models on Kubernetes, particularly focusing on scalability and the context window in large language models. We also discussed the importance of working groups in overcoming these challenges and emerging concerns in AI security.

00:00 Introduction and Welcome Back

00:20 Abdel's Role and Podcast

00:36 Kubernetes and Cloud Native Space

01:14 AI and MLOps Discussion

02:20 Challenges with Large Language Models

04:48 Kubernetes Working Groups

05:55 Security Concerns in MLOps

09:48 Exploring Solutions and Community Interaction

18:23 Conclusion 

 

Guest: Abdel Sghiouar is a Cloud Developer Advocate @Google Cloud. His focus areas are GKE/Kubernetes, Service Mesh and Serverless. Abdel started his career in datacenters and infrastructure in Morocco before moving to Google's largest EU datacenter in Belgium. Then in Sweden he joined Google Cloud Professional Services and spent 5 years working with Google Cloud customers on architecting and designing large scale distributed systems before turning to advocacy and community work. You can follow him at @boredabdel.