Being an account of some things that captured my interest this week.
Apparently last week I’ve been mostly thinking about process.
Details of how Segment reduced their AWS spend. The details on tracking DynamoDB partition imbalance are really useful.
The implication here is that you aren’t paying for total throughput, but rather partition count. And if you happen to have a few keys which saturate the same individual partitions, you have to double capacity to split a single hot partition onto their own partitions rather than scale the capacity linearly.
Latest PipelineDB release introduces Delta Streams.
Perhaps the most powerful capability this enables is the sharing of work between continuous views for greater efficiency and simpler, more elegant continuous topologies.
Counterintuitive things about testing #6: service-oriented-architecture would be the worst thing you could possibly do.
An approach to improve quality and throughput by focussing on bugs.
The crux and the controversial part of this system is that all bugs take priority over all new feature development or improvements.
Deep analysis of how Discord uses ElasticSearch to index billions of messages.
Rethinking the MVP.
MVP is used so much it’s lost its original meaning.
A Riskiest Assumption Test is explicit. There is no need to build more than what’s required to test your largest unknown. No expectation of perfect code or design. No danger it will prematurely become a product.
The biggest problem I’ve seen with the MVP is actually working out what Minimum and Viable actually mean. Products are often pushed with effort in all the wrong places.