M. Cagri AKTASSPOTIFY API to GCLOUD (GStorage — Functions — Cloud Scheduler (cron jab) — BigQuery)Google Cloud Functions4d ago4d ago
M. Cagri AKTASCreating Dask with Dask-Operator — Using KubeCluster and HelmKubernetes — DaskMar 22Mar 22
M. Cagri AKTASHow to get your Google Analytics data with Google Analytics Report APIIf you need to report within your site, you may need to use Google Analytics. Also, for analyzing the rapidly growing consumption and…Mar 2Mar 2
M. Cagri AKTASElasticsearh — SparkElasticsearch is so fun and really good a technology because you can visualize streaming data too. :) Of course Elasticsearch is not only…Nov 2, 2023Nov 2, 2023
M. Cagri AKTASEnd-to-End Project — Streaming Data (DataGenerator->Kafka->SparkStreaming->PostgreSQL)I designed this project to take streaming data, process it through ETL (Extract, Transform, Load) processes, and perform a proper query.Oct 19, 2023Oct 19, 2023
M. Cagri AKTASWhat and How to use from_json and exploed functions a json column in csv files with PySparkwe will explore how to use two essential functions, “from_json” and “exploed”, to manipulate JSON data within CSV files using PySpark.Oct 13, 2023Oct 13, 2023
M. Cagri AKTASApache Spark, Hadoop & Apache Spark and Parquet & Orc FormatI’ll make this article with two part. In the first part, I will cover the Apache Spark ecosystem, and in the second part, we will discuss…Oct 6, 2023Oct 6, 2023
M. Cagri AKTASMonolithic Architecture and Message Bus with Apache KafkaHello everyone, I’ll explain the old message ecosystem and how to join Kafka in this ecosystem. We will build some examples, so please pay…Sep 26, 2023Sep 26, 2023
M. Cagri AKTASApache Hadoop (HDFS -YARN- MapReduce) and Apache Hive EchosystemWe will be discussing Hadoop, Hive, and some SQL queries in Hive, with a special focus on YARN, Hive, External and Internal table types.Sep 19, 2023Sep 19, 2023