PinnedTalk CloudinIndian Mythological sagaVeda Vyasa— The Immortal SageVeda Vyasa is a revered figure in Hinduism, considered one of the most influential sages of ancient India. It is nearly impossible to…Oct 6Oct 6
PinnedTalk CloudThe mechanics of BigQuery — How BigQuery stores data internallyBigQuery is a fully managed, serverless data warehouse from Google, ideal for storing and analyzing large datasets. It offers high…Sep 3Sep 3
Talk CloudData Validation in Data Engineering: Ensuring Data Quality and IntegrityData validation techniques are crucial in data engineering to ensure the quality, consistency, and reliability of data as it flows through…Sep 12Sep 12
Talk CloudUnderstanding working of Cloud Composer — DAG , Operators and Dynamic WorkflowTable of ContentsSep 11Sep 11
Talk CloudNavigating Azure Storage Solutions: A Comprehensive Comparison of Blob Storage and Data Lake Gen2Azure Blob Storage and Azure Data Lake Storage Gen2 are both storage solutions offered by Microsoft Azure, but they serve slightly…May 8May 8
Talk CloudCreating a DYNAMIC apache beam pipeline !!!When conducting a Google search for dynamically creating Apache Beam pipelines, the first thing we get is :Apr 10Apr 10
Talk CloudinILLUMINATION’S MIRRORUnderstanding Overfitting vs. Underfitting in Machine LearningMachine learning models aim to generalize patterns from data and make accurate predictions on unseen examples. However, striking the right…Jan 111Jan 111
Talk CloudinILLUMINATION’S MIRRORGCS to Bigquery — Using Composer, DataFlow, Apache Beam, SQL and XML DataMigration of Data is a part of daily life job for Data Engineers. There is always a source and target where data needs to be moved and…Oct 17, 2023Oct 17, 2023