With the advent of LLMs, deployment, and monitoring of such models is paramount. This talk gives an intro about how ML deployments should be monitored.
Also, this talk covers an overview of observability and monitoring in the context of MLOps and how it can be handled with Prometheus.
Shivay Lamba is a software developer specializing in DevOps, Machine Learning and Full Stack Development.
He is an Open Source Enthusiast and has been part of various programs like Google Code In and...