PinnedNishchay AgrawalinWalmart Global Tech BlogCracking the Code: Boosting Airflow Efficiency Through Airflow Configuration Tuning & OptimisationIn the world of managing data & ETL workflows, Apache Airflow is a crucial tool for automating tasks. However, getting the most out of it…Dec 5, 2023Dec 5, 2023
Nishchay AgrawalChange Data Capture in Snowflake using StreamsChange Data Capture : Capturing CDC in Snowflake using StreamsJun 21Jun 21
Nishchay AgrawalDSnowflake & AWS Secure Integration Framework via Integration ObjectsSnowflake, as we all know is a data warehouse built for the cloud. It allows the users to read/write the data from/to cloud storage. So it…Jun 21Jun 21
Nishchay AgrawalData Engineering Snowflake — Replicate CDC log files (JSON Format) from Data Lake (AWS S3) to…Now a days many companies are moving their Data Warehousing & Business Intelligence(BI) solution into the cloud computing-based…Jun 211Jun 211
Nishchay AgrawalSeamless Data Pipeline: Integrating Kinesis Streams with Snowflake for Real-Time AnalyticsAmazon Kinesis, a managed AWS service, is one of the scalable technologies that enables ingesting large volumes of data in real-time…Jun 21Jun 21
Nishchay AgrawalSnowflake Integration with Amazon S3, Power BI usiETL Projects of UK Licensed Sponsors.Jun 21Jun 21
Nishchay AgrawalWhat is Web application — It is a stand-alone application.It will be having HTML contents.Jun 21Jun 21
Nishchay AgrawalAWS Cloud Data Engineering End-to-End Project — EMR, EC2, Glue, S3, Spark, ZeppelinRepositoryJun 21Jun 21
Nishchay AgrawalSpiThe focus of the course was a pipeline project, where I had the opportunity to work with the Spotify API and various AWS services…Jun 21Jun 21
Nishchay AgrawalCI/CD Integration withIn this blog, we will deploy a node.js application on an EC2 instance and we will create a CICD pipeline using Jenkins.Jun 21Jun 21