tianle chenTech Debt is Fun in FactorioFor some reason or another, dealing with scaling challenges is fun in Factorio (well, people do pay money for it)! Here I’ll illustrate how…Oct 10, 2022Oct 10, 2022
tianle chenWhy can’t I just cron my batch pipeline?Say you’ve created an application to extract value out of data, now you need to rerun a series of steps periodically to generate new data…Sep 19, 20221Sep 19, 20221
tianle chenNew Final Final (2) Copy: Ideas in Version ControlThere comes a time in every project when one has to come to terms with the mess that they have made. The number of files are sprawling and…Jul 26, 20221Jul 26, 20221
tianle chenComputations on Distributed DatasetsOverview on the whys and how's of computations on distributed datasets — and what’s this Map Reduce thing anyway?Jan 30, 20221Jan 30, 20221