FilipaData Architecture (& Agreements) — from ingestion to visualisationA solid data architecture is a blueprint that helps align your company’s data with its business strategies. Build a solid one!Mar 20Mar 20
FilipaHow to save a pandas DataFrame to Redshift locallyIn this article, we’ll make use of awswrangler and redshift-connector libraries to seamlessly copy data to your database locally. It goes…Feb 27Feb 27
FilipaDynamically trim incoming data if it exceeds what specified in schemaCopy S3 to Redshift — String length exceeds DDL length: the length of the data column ‘comment’ is longer than the length defined in the…Feb 15Feb 15
FilipaCreating a Table from a Schema defined in YAMLThere is a lot we can do with YAML files. In this article, I’ll give you some ready-to-use methods to unleash the power of YAML in your…Feb 7Feb 7
FilipaWhy should you automate the refresh of your Tableau dashboards in your Airflow pipelinesStop scheduled Extract Refreshes in Tableau and spare your database.Feb 1Feb 1
FilipaHow to troubleshoot a failed Spark step in Amazon EMR?EMR (Elastic MapReduce) is designed for processing large-scale data using frameworks like Apache Spark. You want to use EMR when you are…Jan 31Jan 31
