Effective Observability for MLOps Pipelines at Scale

With the advent of LLMs, deployment, and monitoring of such models is paramount. This talk gives an intro about how ML deployments should be monitored.

Also, this talk covers an overview of observability and monitoring in the context of MLOps and how it can be handled with Prometheus.

Speakers

shivay-lamba

Shivay Lamba

 

Shivay Lamba is a software developer specializing in DevOps, Machine Learning and Full Stack Development.

He is an Open Source Enthusiast and has been part of various programs like Google Code In and

... rishit-dagli

Rishit Dagli

 
I am a CS Freshman at The University of Toronto. I love researching and working with Machine Learning, especially Computer Vision (with papers in ICLR, Nature, and ACM SIGGRAPH among others, and have ...