Transforming Medical Documents with Generative AI: From Unstructured to Structured DataIn the healthcare industry, vast amounts of data are stored in unstructured formats such as medical records (e.g. clinical records)…Jun 16Jun 16
Honest Confession : Feeling dumb after this silly AWS problem killed my valuable work time!Have you ever found yourself in a situation where a straightforward task turns into a time-consuming puzzle?May 11May 11
Data Store vs MetaStoreIn the world of Big Data Analytics, efficient data management is key, and at the heart of this lies the Metastore. But what exactly is a…Mar 28Mar 28
AWS Athena for Data as a Service: A Seamless Event-Driven ArchitectureIn the world of cloud computing, we’ve witnessed the evolution of various “as a Service” models — Infrastructure as a Service (IaaS)…Mar 27Mar 27
Projects I’ve Worked as Marketing Data Engineer in IDFC First Bank 👨🏻💻Being a Data Engineer in Marketing Team, I got to work on multiple types of projects in my 1.6 years tenure with IDFC First Bank , one of…Mar 26Mar 26
🛠️ Fixing the Small File Problem in Data Lake with SparkWe regularly receive diverse types of logs, including web access logs, application logs, and IoT device logs, which are stored in…Mar 21Mar 21
✨Functionless, Codeless, and Lambda-less Integration Patterns! 🌐Whenever we need to connect or integrate two or more AWS services, the first thing that often comes to mind is AWS Lambda. However, let’s…Mar 3Mar 3
Break into Data Engineering ,100% free and 100% project-based!🚀 Welcome, Data Enthusiasts! In this guide, I walk you through a 100% free, 100% project-based approach to break into Data Engineering!Feb 27Feb 27
How to: Use Snowpark with AWS GlueHello Everyone , today, we’re diving into the powerful combination of Snowpark & AWS Glue, a game-changer for data engineers in the…Feb 26Feb 26
Master Containerization with AWS: Docker, ECR, ECS & Fargate — A Comprehensive Learning PathContainerization has become a cornerstone in modern software development, offering scalability, portability, and ease of deployment. Here…Feb 9Feb 9
