Abstract:

It’s always a tradeoff between stability and velocity when it comes to optimizing the business outcome. In this talk I will share my experience in stabilizing the system as gojek grew from ~100+ instances to ~5K+ and growing instances.

Talk Description:

In this talk I will start with the description of the gojek infra when it was small. The tools and practices that we followed to serve the needs of that time.

When the organisation was small velocity took precedence. We started adding simple solutions like CI/CD, configuration management, basic monitoring, alerting and basic automation. It enabled the organisation to deliver new features with speed and stability. Things were usually simple. Less number of services and components to monitor. Everyone is responsible for everything. Each and every alerts are usually actionable by most of the people.

Then I'll talk about the shortcomings that we faced once the infrastructure grew further. When business flourished, infrastructure became large and the number of people multiplied. The solutions we implemented earlier were not sufficient anymore. We started to face issues like alert getting lost, not getting alerts to a right person, too many people getting too many pagers, who is responsible to take action on a particular alert. And hence it resulted in major outages and serious business loss.

Then I'll talk about the changes that we brought to tackle such issues. Will discuss about the new tools and applications we created and the problems they solve.

This talk will revolve mostly around the devops culture and SRE responsibilities. How both these things are closely connected and how they evolve with scale.

I’am an engineer at gojek. Over the last 2 years, I have worked on development, infrastructure automation, centralized logging, monitoring and now part of SRE team. This talk is about what

Senior SRE at Go-Jek India.

Organiser of DevOpsDay India.