PinnedHussein AwalainApache AirflowAirflow: Scalable and Cost-Effective ArchitectureExplore one of the best Airflow architectures for big projects to reduce the execution latency, the infra cost and the resources usage.Jul 3, 2023Jul 3, 2023
Hussein AwalainStackademicThe Golden Path for Spark On KubernetesA new way to easily submit and manage your Spark applications on Kubernetes.Jan 291Jan 291
Hussein AwalainApache AirflowAirflow Setup and Teardown TasksHow Airflow helps its users to setup and clean up the infrastructure resources needed to execute their dags.Aug 21, 2023Aug 21, 2023
Hussein AwalainTech BlogAre You Using Parquet with Pandas in the Right Way?Are you utilizing the combo of pandas and Parquet files effectively? Let’s ensure you’re making the most out of this powerful combination.Jul 24, 20233Jul 24, 20233