Paul Dominic P. PacquingDeveloping and testing AWS Glue ETL scripts locally using containersBefore AWS Glue, most of our Apache Spark jobs were running on AWS EMR. Since Apache Spark (and friends) on EMR is the real deal (vanilla)…Nov 7, 20213Nov 7, 20213
Paul Dominic P. PacquinginThe StartupMLFlow With MinIO (Special Guest Apache Spark)For the past few days, I’ve been exploring MLFlow and its application to our Machine Learning pipeline.Jul 29, 2020Jul 29, 2020