Hacking Analytics’ Compendium of Data News — December 2020
This month was quite active with news and release in the Data space, with two big conferences going on — Amazon’s re:Invent and Neurips, as well as the official release of Airflow 2.0 and an introduction to the principles and architecture of the Data Mesh…
SQL, Databases, and ETL
SQLite received a new release(3.34.0) providing increased support for recursive queries, and an increased query planner.
Amazon open-sourced Babelfish to provide a SQL Server/T-SQL compatibility layer for Postgres. Postgres also received a docker image in which IVM (incremental view maintenance) is implemented.
Cockroach DB explained why they are compatible with Postgres, as well as how they built their spatial indexing.
On the orchestrators front, we saw the release of Airflow 2.0, as well as the introduction by Uber of their “no-code” workflow orchestrator uWorc built on top of Airflow.
Data Management and Architecture
Martin Flowler’ blog published an introduction to the principles and logical Architecture of the Data Mesh and Ali Ghodsi’s paper on the Lakehouse architecture got published on CIDR’s website.
