PinnedraphaelauvinTowards Data ScienceApache Airflow : 10 rules to make it work ( scale )Airflow is by default very permissive and without very strict rules it will fail to scale.7 min read·Feb 13, 2022--9--9
raphaelauvIt’s time to do infra as REAL codeIt’s time to use programming languages(python , go , java , typescript …) and no more declarative configuration languages ( HCL , YAML …2 min read·Feb 12, 2022----
raphaelauvScale vertically Kafka consumersLow footprint multi-threaded Kafka Consumers using CompletionService.3 min read·Sep 22, 2020----