Postgres

Optimising PostgreSQL Indexes for Bulk Operations

A beginner’s approach to fixing PostgreSQL timeouts

This is the beginning of a series of blogs on my…

Surprises while splitting CSVs

At carwow, we load all our production Postgres databases into a data warehouse daily; the process is pretty much:

1. Use COPY FROM to extract the data as a CSV
2. Split the CSV into roughly evenly-sized, gzipped chunks

Managing your Elasticsearch indexes in Rails

Most Rails apps start life with a single relational database (generally PostgreSQL or MySQL), which are great for many purposes, but can get pretty slow when doing unstructured searches over huge datasets. When you hit this kind of problem, it’s time…

Using realistic data locally

When developing features it is handy to be able to test with a “real” dataset and not just a bunch of randomly generated data.

This means it there are less surprises when the feature gets deployed — both in terms of scalability but also content.

PostgreSQL vs. pandas — how to balance tasks between server and client side

Problems with concurrent Postgres indexes (and how to solve them)

Since I read the article linked below:

Large tables behave differently

On my bugs duty I’ve noticed that a query was timing out.

The ruby code was simple: