Constantin LunguinData Engineer’s NotesWhy how the data is collected mattersI find that working with data daily significantly influences how you perceive the world around you. You begin to notice patterns and…Aug 6Aug 6
Constantin LunguinData Engineer’s NotesCalculating the Median in BigQueryOne of these days, I had to handle missing value imputation and stumbled upon the need to calculate a median in BigQuery SQL. Since there…Aug 6Aug 6
Constantin LunguinData Engineer’s NotesDynamically extracting JSON data in BigQueryI was asked today about dynamically extracting key-value pairs from heterogeneous JSON-like strings in BigQuery SQL and I’ve remembered…Aug 6Aug 6
Constantin LunguinData Engineer’s NotesUsing tempfile module in PythonIn this world, everything is ephemeral. If you need to create temporary files or directories in Python, check out the tempfile module.Aug 6Aug 6
Constantin LunguinData Engineer’s NotesA quick look at the json module in PythonIf you ever need to work with JSON files in Python, you’re going to encounter the module with the same name.Aug 6Aug 6
Constantin LunguinData Engineer’s NotesRetrying in Python using tenacitytenacity — (noun) the quality or fact of continuing to exist; persistence.Aug 6Aug 6
Constantin LunguinData Engineer’s Notessorted(List) vs List.sorted() in PythonWhen I was just starting out with Python I found the distinction between a function doing something in place and returning the result…Aug 41Aug 41
Constantin LunguinData Engineer’s NotesUsing virtual environments in PythonIn one of my previous posts, we looked at the basics of installing packages in Python using pip.Jul 281Jul 281
Constantin LunguinData Engineer’s NotesInstalling Python packages with pipHere are the basics you need to know about installing Python packages.Jul 27Jul 27
Constantin LunguinData Engineer’s NotesA practical exercise working with ARRAYS and correlated subqueries in BigQueryHere’s an interesting SQL problem, similar to one I had to solve the other day. It involves some of our favourite BigQuery ARRAYS, but also…Jul 6Jul 6