Tagged in

Computer Science

Build and Learn

Thoughts from a Data Consultant — marcin.tustin@gmail.com

More information

Followers

Elsewhere

More, on Medium

Computer Science

Marcin Tustin in Build and Learn

Dec 16, 2017

Perfect table migrations in redshift and hive

Always do your migrations like this

Here’s a neat little trick due to David Heller at Alooma — perform any migration in redshift (or other columnar store) without any need for downtime, table locking…

Marcin Tustin in Build and Learn

I’m not sure this is right. Random access busts caches (slowing reads), and more generally linear access is more capable of being optimized by preloading. This effect is even greater when data are spread across different network nodes (because network IO is relatively slow and relatively easy to saturate).