The On-Prem AI Challenge: DevOps Strategies for Air-Gapped Success

Talk

Bringing AI/ML workloads on-prem, especially into air-gapped environments, presents unique hurdles beyond typical cloud deployments. This session dives into the practical DevOps strategies required to succeed. We’ll explore tackling challenges like managing complex infrastructure (GPUs!), handling large datasets securely, automating model pipelines without external access, and maintaining tooling/dependencies offline. Leave with actionable insights on adapting CI/CD, IaC, and MLOps practices to deliver AI value securely within highly restricted networks.

Speaker

ion-mudreac

Ion Mudreac

 
Ion has 20+ years of IT experience, starting in academia before global roles in FinTech (Merrill Lynch, Commerzbank) and co-founding a startup. He built the Cloud Dev, SRE & Data teams for MOX ...