The Perils of Heroic Data Work: Just Say, “Eww.” | DataKitchen

We’ve all been there. You’re up against a deadline, working tirelessly to get the job done. But what happens when that “job” leaves a hairball of technical debt that will need to be fixed and improved tomorrow? And what if, in a rush to get it done, you’re skipping key steps like automated testing and version control? Believe me, I know how tempting it can be to take shortcuts when you’re under pressure. But trust me when I say that it’s not worth it.

When you’re working with data, it’s important to remember that quality trumps quantity every time. Sure, you might be able to deliver the goods on Monday morning with a “heroic” all-nighter. But what happens when your work is riddled with errors? Not only will you have to go back and fix those errors, but you’ll also likely damage your credibility in the process. Worse yet, your shoddy work could end up costing the company money.

And let’s not forget about the long-term effects of taking shortcuts. When you skip key steps in the data process-like automated testing and version control-you’re setting yourself (and your team) up for future problems. It may not seem like a big deal at the moment, but down the line, you’ll wish you had taken the time to do things right.

Originally published at https://datakitchen.io on October 18, 2022.