Erkan ŞirinDeploying Scikit-learn Models on Spark: A Comprehensive GuideMachine learning models form the basis of data analysis and predictions in many fields today. Scikit-learn, on the other hand, has been the…Jul 3Jul 3
Erkan ŞirinPolars ClickHouse Reading and Writing DataRegularly cleaning raw data, storing it in analytical environments, and performing analysis, visualization, and artificial intelligence…Jun 5Jun 5
Erkan ŞirinApache Airflow Installation with Docker ComposeWe will see how to quickly and easily install Airflow using Docker Compose and a example DAG.May 22May 22
Erkan ŞirinPySpark and JupyterLab Installation with DockerFind out easy installation of PySpark and Jupyter with Docker.May 5May 5
Erkan ŞirinAWS Glue: A Simple ETL Implementation withAWS Glue is a serverless data integration service that makes it easy to discover, prepare, migrate, and integrate data from multiple…May 23, 2023May 23, 2023
Erkan ŞirinNine Different Environments to Use Apache SparkApache Spark is a very popular tool in the big data and analytics world. We can use Spark for many different purposes and run it in many…Feb 23, 2023Feb 23, 2023
Erkan ŞirinML Model Deployment with FastAPI, Docker, and TerraformMachine learning is one of the most popular fields in recent years. Many people strive to gain knowledge and skills in this field. Despite…Dec 27, 2022Dec 27, 2022
Erkan ŞirinStoring and Retrieving Scikit-learn Model to/from S3Hello. In this article, we will learn how to save ml models to objecting storage and read them when necessary. The example will be on the…Dec 5, 2022Dec 5, 2022
Erkan ŞirinApache Flink and Kafka: Simple Example with ScalaApache Flink is a very successful and popular tool for real-time data processing. Even so, finding enough resources and up-to-date examples…Nov 14, 2022Nov 14, 2022
Erkan ŞirinSpark SQL Window FunctionsWindow functions are commonly known in the SQL world. We can use many functions that we use in SQL with Spark. In this article, we will…Jul 30, 2022Jul 30, 2022