Louis GinTowards Data EngineeringHow to Choose an Azure SQL Database for Your ApplicationDec 11, 2023Dec 11, 2023
Louis GinTowards Data EngineeringRobust Code in Python Data Engineering: Part Four— User-Defined TypesUser-defined types in Python allow you to communicate domain-specific knowledge to your users and fellow engineers.Aug 1, 20231Aug 1, 20231
Louis GUsing Azure Secrets for Databricks Authentication to Azure Data Lake Storage Gen2There are a number of ways to enable secure access to Azure Data Lake Storage Gen2 from Azure Databricks. Each Azure storage account is…Jul 29, 2023Jul 29, 2023
Louis GinPlumbers Of Data ScienceHow to write your own context managers in Python for Data EngineeringWhen designing your functions and classes for Data Engineering, the interfaces you build should be easy to use correctly and hard to use…Jul 21, 2023Jul 21, 2023
Louis GinTowards Data EngineeringHow to choose a NoSQL database for your applicationNoSQL stands for ‘not only SQL’, and represents a group of non-relational database categories that can handle various data types, including…Jun 26, 2023Jun 26, 2023
Louis GinPython in Plain English6 Tips for Writing Clean and Maintainable Python functions for Data EngineeringWhat does clean and maintainable code mean?Jun 23, 20231Jun 23, 20231
Louis GinTowards Data EngineeringRobust code in Python Data Engineering: Part Three — Advanced Type AnnotationsThis article is the third in a series examining robust coding in Python-based Data Engineering. Article two can be found here.Jun 19, 20231Jun 19, 20231
Louis GinPlumbers Of Data ScienceHow to use JSON data in SnowflakeSemi-structured data used to be hard in SQL, Snowflake has made it easy.Jun 15, 20231Jun 15, 20231
Louis GinTowards Data EngineeringRobust code in Python Data Engineering: Part One — What is robust code?A key part of any Data Engineering codebase is flexibility. Clients come and go, stakeholders rotate, priorities shift, and with them, the…Jun 13, 20232Jun 13, 20232
Louis GinTowards Data EngineeringRobust code in Python Data Engineering: Part Two — Type AnnotationsThis is the second article in a series exploring robust code in Python-based Data Engineering and how you can deliver it. Part one can be…Jun 13, 20231Jun 13, 20231