Erkan ŞirinPolars ClickHouse Reading and Writing DataRegularly cleaning raw data, storing it in analytical environments, and performing analysis, visualization, and artificial intelligence…4 min read·6 days ago----
Erkan ŞirinApache Airflow Installation with Docker ComposeWe will see how to quickly and easily install Airflow using Docker Compose and a example DAG.5 min read·May 22, 2024----
Erkan ŞirinPySpark and JupyterLab Installation with DockerFind out easy installation of PySpark and Jupyter with Docker.4 min read·May 5, 2024----
Erkan ŞirinAWS Glue: A Simple ETL Implementation withAWS Glue is a serverless data integration service that makes it easy to discover, prepare, migrate, and integrate data from multiple…5 min read·May 23, 2023----
Erkan ŞirinNine Different Environments to Use Apache SparkApache Spark is a very popular tool in the big data and analytics world. We can use Spark for many different purposes and run it in many…3 min read·Feb 23, 2023----
Erkan ŞirinML Model Deployment with FastAPI, Docker, and TerraformMachine learning is one of the most popular fields in recent years. Many people strive to gain knowledge and skills in this field. Despite…4 min read·Dec 27, 2022----
Erkan ŞirinStoring and Retrieving Scikit-learn Model to/from S3Hello. In this article, we will learn how to save ml models to objecting storage and read them when necessary. The example will be on the…3 min read·Dec 5, 2022----
Erkan ŞirinApache Flink and Kafka: Simple Example with ScalaApache Flink is a very successful and popular tool for real-time data processing. Even so, finding enough resources and up-to-date examples…5 min read·Nov 14, 2022----
Erkan ŞirinSpark SQL Window FunctionsWindow functions are commonly known in the SQL world. We can use many functions that we use in SQL with Spark. In this article, we will…5 min read·Jul 30, 2022----
Erkan ŞirinMulti-node Zookeeper-less Kafka Cluster Setup with DockerAs we know, Kafka has recently ended the Zookeeper dependency (KIP-500 Kafka 2.8.0). Although existing Kafka Clusters use Zookeeper, this…7 min read·Jul 26, 2022--1--1