MLOps Meetup #23 // Monitoring the ML stack // Lina Weichbrodt

How To Monitor Machine Learning Stacks - Why Current Monitoring is Unable to Detect Serious Issues and What to Do About It with Lina Weichbrodt.   Monitoring usually focusses on the “four golden signals”: latency, errors, traffic, and saturation. Machine learning services can suffer from special types of problems that are hard to detect with these signals. The talk will introduce these problems with practical examples and suggests additional metrics that can be used to detect them.  A case study demonstrates how these new metrics work for the recommendation stacks at Zalando, one of Europe’s largest fashion retailers.   Lina has 8+ years of industry experience in developing scalable machine learning models and bringing them into production. She currently works as the Machine Learning Lead Engineer in the data science group of the German online bank DKB. She previously worked at Zalando, one of Europe’s biggest online fashion retailers, where she developed real-time, deep learning personalization models for more than 32M users.    Join our Slack community: https://join.slack.com/t/mlops-community/shared_invite/zt-391hcpnl-aSwNf_X5RyYSh40MiRe9Lw   Follow us on Twitter: @mlopscommunity   Sign up for the next meetup:   https://go.mlops.community/register Connect with Demetrios on Linkedin: https://www.linkedin.com/in/dpbrinkm/ Connect with Lina on Linkedin:  https://www.linkedin.com/in/lina-weichbrodt-344a066a/