Varnit SinghHow to consolidate data from multiple different sources into one?This is an age old question of data engineering which a beginner asks when first dealing with such a problem. The standard approach is to…Sep 30
Michaël ScherdingSpicing up GCS to BigQuery transfers from Dataform with BigFunctionsContext and ideaJul 26
LAKSHMI VENKATESHTowards Data & Cloud #5: Data Ingestion Frameworks (Part 1)Framework, Tools & Technology FocusMar 19Mar 19
Caio VelascoLeveraging dbt-DuckDB to perform an Ingestion Step (Reading from Postgres, converting to Parquet…Today, I’m happy to share that I finished the first part of a Data Engineering project. It leverages the power of DuckDB by using dbt Labs.Jul 12Jul 12
Varnit SinghHow to consolidate data from multiple different sources into one?This is an age old question of data engineering which a beginner asks when first dealing with such a problem. The standard approach is to…Sep 30
Michaël ScherdingSpicing up GCS to BigQuery transfers from Dataform with BigFunctionsContext and ideaJul 26
LAKSHMI VENKATESHTowards Data & Cloud #5: Data Ingestion Frameworks (Part 1)Framework, Tools & Technology FocusMar 19
Caio VelascoLeveraging dbt-DuckDB to perform an Ingestion Step (Reading from Postgres, converting to Parquet…Today, I’m happy to share that I finished the first part of a Data Engineering project. It leverages the power of DuckDB by using dbt Labs.Jul 12
FleakOptimizing Embedding Ingestion: Best Practices and TipsEmbeddings are a foundational element in modern AI, enabling advancements in areas like natural language processing and image recognition…Sep 3
Kanerika IncThe Big Data Cloud — All You Need To Know in 2024By 2025, people will generate more than 181 zettabytes of data. To put it into perspective, the number is 181, followed by 21 zeros.Jun 27
Kyle HoondertLoading MySQL tables into Apache DruidA recent discussion on the Apache Druid Slack channel encouraged me to do a little write up on loading data into Apache Druid from an…Aug 23, 2022
