Prasoon ParasharHow to use AWS Customer Managed Keys, Secret Manager and AWS Toolkit to secure credentials (in…In today’s digital landscape, managing and securing access to resources and sensitive data are paramount. In this blog post we will explore…Sep 14, 20231Sep 14, 20231
Prasoon ParasharHow to transfer files between S3 Buckets based on time using Lambda function in python?In this blog, we’ll explore a crucial topic: How to efficiently manage scenarios where multiple Parquet files find their way into our data…Aug 28, 2023Aug 28, 2023
Prasoon ParasharHow to give policy-based access control to your s3 Bucket?Hello there! Welcome to this blog on a crucial topic in the realm of data security — fine-tuning S3 bucket access with IAM policies. You…Aug 26, 2023Aug 26, 2023
Prasoon ParasharReal-time Data Ingestion: Building an AWS S3 Data Lake with Kafka Consumer in ScalaHello data enthusiasts! Welcome to this comprehensive guide on building an end-to-end big data pipeline. Today, we’ll explore the journey…Jul 25, 2023Jul 25, 2023
Prasoon ParasharHow to Set up CDC with Kafka, Debezium and Postgres ?In this blog, I will guide you through the process of setting up Change Data Capture (CDC) with Kafka and Postgres on Google Cloud. CDC…Jul 1, 20232Jul 1, 20232
Prasoon ParasharOrganize Your Big Data Project for Efficiency, Scalability, and MaintainabilityIn the realm of big data, organizing your project with a well-defined folder structure is crucial for its success. A well-structured…Jun 21, 2023Jun 21, 2023
Prasoon ParasharGenerating and Populating Tables with Synthetic Data at Adjustable RatesThis Python-based data generation code has been specially designed to generate dummy data for an e-commerce application. Its primary target…Jun 17, 2023Jun 17, 2023