Matt SimmonsinDatasparq Technology🚀 Houston: A better approach to workflow orchestrationComplex workflows (data pipelines, ML prediction pipelines, optimisation algorithms, etc.) always need orchestration.Feb 14Feb 14
Matt SimmonsinDatasparq TechnologyCreating an SSH Key for Git, Explained for 5 Year OldsWhen you’re only 5 years old, it can be confusing to use git and ssh, due to the many different concepts involved. This guide explains each…Apr 18, 2023Apr 18, 2023
Matt SimmonsinDatasparq TechnologyWhat Is PlayML?Question: When’s the last time Machine Learning (ML) directly influenced your behaviour? Answer: At least 10 times today so far.Mar 28, 20221Mar 28, 20221
Matt SimmonsinDatasparq TechnologyWhy I like Go so much, with examplesOut of all the languages I’ve used, Go is the best. I find myself saying this to a lot of people, so here’s my attempt to explain why.Mar 17, 20228Mar 17, 20228
Matt SimmonsinDatasparq TechnologyWhat Can a Software Engineer Learn From a Rocket Engineer? Quite A Lot Actually.Imagine you’re building thousands of rocket engines and spending billions of dollars on a quest to make humanity a multi-planetary species…Sep 2, 20211Sep 2, 20211
Matt SimmonsinDatasparq TechnologySo you think you know Python?I promise I’m not gatekeeping.Jun 3, 20215Jun 3, 20215
Matt SimmonsinDatasparq TechnologyKubeflow Pros and Cons: Kubeflow vs Airflow vs SageMakerWe’ve recently used Kubeflow to build a Machine Learning app in AWS. It’s worked out well, but would we choose to do it again?Dec 7, 20201Dec 7, 20201
Matt SimmonsinDatasparq TechnologyHow to deploy a Python Function App in Azure with TerraformWe defined all of the infrastructure in Terraform, with an aim to deploy multiple functions, topics, and subscriptions in a single click.Jun 22, 20204Jun 22, 20204
Matt SimmonsinDatasparq TechnologyAirflow’s dashboard was testing our patience, so we made our owntl;dr: Creating/editing a pipeline visually is impossible in existing tools and it makes data engineering a chore. This new approach…Apr 6, 2020Apr 6, 2020