Published in Towards Data Science·Apr 23, 2021PR Reviews for SQL codeThis is my personal guide on how I review my peer SQL code. As I mentioned before, at Shopify, all our work is peer reviewed. This includes dashboards and SQL code. One of the most used tools for data scientists at Shopify is Mode. …Sql10 min read
Published in Towards Data Science·Jan 29, 2021Warning systems on data warehouseThe story of how and why I built Whistleblower, a system that allows us to set warnings on any table in our environment. — For the past couple of years, myself and a bunch of others at Shopify were looking for a smart way to set warnings on specific tables. Why warnings? The reason is quite simple, we spend a lot of time building quality front room datasets, as I explain in this previous…Editors Pick6 min read
Published in Shopify Data·Jun 9, 2020How to thrive in the face of disruption: Tips from Shopify’s Data TeamShopify’s Data Science & Engineering Foundations We currently face a global pandemic. People are in pain around the world. Daily life has been disrupted. Many face monumental financial damage or unemployment. …Data Science9 min read
Published in Towards Data Science·Oct 28, 2019Using Data Science to save money on my next trip to MexicoHow am I using basic data work to ensure I am getting a good price on my trip. — It has been 4 years since my wife and I took some vacation in a sunny place. Last time, for our honeymoon, we spent some quality time in Mexico. We enjoyed 10 days in a very nice all-inclusive resort in Riviera Maya. Since then, a house, two kids, a new…AWS Lambda6 min read
Published in Towards Data Science·Apr 29, 2019Spark & AI Summit 2019My review of the latest Spark and AI Summit hosted in San Francisco on April 24th and 25th 2019. Last week was hosted the latest edition of the Spark Conference. It was the first time for me attending the conference. …Big Data4 min read
Published in Towards Data Science·Apr 17, 2019Spark JOIN using REGEXA more technical post about how I end up efficiently JOINING 2 datasets with REGEX using a custom UDF in SPARK Context For the past couple of months I have been struggling with this small problem. …Regex4 min read
Published in Towards Data Science·Sep 27, 2018The data science pyramidLet’s not start with data science this time. Let’s start with psychology. I am far from having any competence in this domain, but I remember in high school being presented the Maslow’s hierarchy of needs. The best I can describe it is the different stage humans must go through to…Data Science4 min read
Published in Towards Data Science·Apr 27, 2018This is what I really do as a Data ScientistData Science is getting very popular and many people are trying to jump into the bandwagon, and this is GREAT. But many assume that data science, machine learning, plug any other buzzword here, is to plug data to some Sckit-Learn libraries. Here is what the actual job is. To bring…Machine Learning5 min read
Published in Towards Data Science·Feb 15, 2018Lossless Triplet lossA more efficient loss function for Siamese NN — At work, we are working with Siamese Neural Net (NN) for one shot training on telecom data. Our goal is to create a NN that can easily detect failure in Telecom Operators networks. To do so, we are building this N dimension encoding to describe the actual status of the…Machine Learning7 min read
Published in Towards Data Science·Nov 22, 2017KOLMOGOROV–SMIRNOV TESTA needed tool in your data science toolbox — Lately, at work, we had to do a lot of unsupervised classification. We basically had to distinguish N classes from a sample population. …Machine Learning6 min read
