PinnedraphaelauvinTowards Data ScienceApache Airflow : 10 rules to make it work ( scale )Airflow is by default very permissive and without very strict rules it will fail to scale.Feb 13, 20229Feb 13, 20229
raphaelauvIt’s time to do infra as REAL codeIt’s time to use programming languages(python , go , java , typescript …) and no more declarative configuration languages ( HCL , YAML …Feb 12, 2022Feb 12, 2022
raphaelauvScale vertically Kafka consumersLow footprint multi-threaded Kafka Consumers using CompletionService.Sep 22, 2020Sep 22, 2020