There’s often a push for data engineers and data scientists to adopt every pattern that software engineers use. But adopting things that are successful in one domain without understanding how it applies to another domain can lead to “cargo cult” type behavior. There are fundamental differences why working with data may require different workflows and systems, and that’s OK!
Founder, working on something new
Erik Bernhardsson is currently exploring some ideas in data infrastructure. He was previously the CTO at Better where he built a 300-person tech team. Before then, he was at Spotify for seven years where he built the first version of their music recommendation system.