Homepage
Open in app
Sign in
Get started
YipitData Engineering
Follow
Instance Auto Scaling Using AWS Capacity Providers
Instance Auto Scaling Using AWS Capacity Providers
Incorporating capacity providers into your ECS architecture using CDK
Annie Holladay
Oct 4, 2022
Authentication and Authorization (Auth) using AWS Cognito
Authentication and Authorization (Auth) using AWS Cognito
Enabling sector-based auth using Google IdP and Cognito
Priyam Sarma
Jul 29, 2021
Recurring data delivery and ingestion with S3 bucket replication
Recurring data delivery and ingestion with S3 bucket replication
Simplify data delivery and ingestion and set it up in 5 minutes with AWS CDK
Angely Philip
Jun 1, 2021
Reducing Burnout with Support Rotations
Reducing Burnout with Support Rotations
A business hours support rotation can reduce burnout and context switching, reduce overall support time, and increase knowledge sharing
Jim Shields
Feb 25, 2021
How to use Broadcasting for more efficient joins in Spark
How to use Broadcasting for more efficient joins in Spark
Our Analysts’ time is our most important resource, and small Spark efficiency tricks, like broadcast joins, can make a big difference
Hillevi Eklöw
Jan 25, 2021
Why We Chose AWS X-Ray (for now)
Why We Chose AWS X-Ray (for now)
This is the second post in a series about YipitData’s ongoing experiment with distributed tracing.
Jim Shields
Nov 17, 2020
Distributed Tracing for a Small Team
Distributed Tracing for a Small Team
Is distributed tracing valuable for a small engineering team?
Jim Shields
Aug 5, 2020
A Better Browsing experience for S3
A Better Browsing experience for S3
At YipitData our Analysts often need to view S3 buckets to check 3rd party data deliveries, as well as our own data exports. This can be…
Andrew Gross
Jul 24, 2020
The most useful PySpark Function
The most useful PySpark Function
Why you should be using input_file_name
Andrew Gross
Jul 8, 2020
How YipitData slashed over $2.5 million off of our AWS bill
How YipitData slashed over $2.5 million off of our AWS bill
Stop burning money.
Steve Pulec
Apr 13, 2020
DRedis — Our disk-based Redis implementation
DRedis — Our disk-based Redis implementation
YipitData’s solution to Redis memory limitations
Hillevi Eklöw
Nov 6, 2019
Managing Breaking Changes at YipitData
Managing Breaking Changes at YipitData
This is a chronicle of the motivations, decision-making, and steps in the slimming of Pipeapp.
Conor Reid
Oct 30, 2019
How We Ran a Successful Failed Experiment
How We Ran a Successful Failed Experiment
Experiments At YipitData
Jim Shields
Aug 16, 2019
Interesting content Friday — 2019/08/09
Teach Yourself Programming in Ten Years, Defining Kevin Hart, 2020 and Beyond Programming Trend Predictions
Hugo Lopes Tavares
Aug 9, 2019
Interesting content Friday — 2019/07/19
Dark language, Derek Sivers, Deploy != Release
Hugo Lopes Tavares
Jul 19, 2019
Interesting content Friday — 2019/07/12
Brag document, Seth Godin, Cloudflare outage, and a funny video about conference calls
Hugo Lopes Tavares
Jul 12, 2019
Interesting content Friday — 2019/06/21
Links about Facebook Libra, Google Stadia, and a 2013 interview with James Hamilton from AWS
Hugo Lopes Tavares
Jun 21, 2019
User-Driven APIs
User-Driven APIs
Some tips for designing APIs for users
Jim Shields
Jun 13, 2019
Interesting content Friday — 2019/06/07
[52min Video] Don’t Walk Away from Complexity, Run — Venkat Subramaniam
Hugo Lopes Tavares
Jun 7, 2019
Migrating to Python 3
“It’s probably not going to be a fun project — in fact it might be really annoying and tedious — but you’ll learn a lot and will get to…
Sam Larson
Jun 4, 2019
Interesting content Friday — 2019/05/24
This week’s links include: “How to Deliver Constructive Feedback in Difficult Situations,” Cython, and “How Netflix Thinks of DevOps”
Hugo Lopes Tavares
May 24, 2019
Interesting content Friday — 2019/05/17
Hello folks, have you considered supporting the Python Software Foundation? I decided to support the PSF and shared my reasons. Enjoy…
Hugo Lopes Tavares
May 17, 2019
Our queueing solution
Our queueing solution
At YipitData we have built a queueing system that works well for web scraping. When we started to develop this system back in 2014, we…
Hugo Lopes Tavares
May 16, 2019
Interesting content Friday — 2019/05/10
Hello folks, I was away for a few weeks but I’m back with some cool links for you, enjoy!
Hugo Lopes Tavares
May 10, 2019
Interesting content Friday — 2019/04/12
Video of Writing Viruses for Fun, not Profit, the book Atomic Habits, and the article The“Backendification” of Frontend Development’
Hugo Lopes Tavares
Apr 14, 2019
About YipitData Engineering
Latest Stories
Archive
About Medium
Terms
Privacy
Teams