What is the mortal sin of software engineering? Wasting effort, time, and money building something that is never used.
In this talk, I’ll show you how to build trustworthy data products. I start with defining business requirements and involving users. No, it is not an optional step. After that, I talk about ensuring quality during data ingestion and processing.
Bartosz Mikulski is a data engineer, blogger, trainer, and speaker. He is interested in building data pipelines that can run without human interventions. No manual fixes, no bugs reported
...