Building Data Pipelines with Luigi
All data science solutions start off as a prototype. As we start proving our hypothesis, we build on top of existing prototypes, which soon bloats. The real challenge begins when we need to run this prototype in production which obviously has to be a scalable system…
