Athena

# create Table for ALB Logs Note: make sure to update query with appropriate values of s3 CREATE EXTERNAL TABLE IF NOT EXISTS alb_logs ( type string, time…

I learned the perspective. I travelled to outer-space, where they only play four-dimensional chess, where the schemes are just factors in equations at best. The studied science of quiet patience, foresight to capture in the end-game, commit to their proud understanding, but transcend it again. Gods and goddesses, no doubt…

I use dbt heavily in my role as a Data Engineer at 1Password and I’m constantly trying to learn how it works under the hood. dbt has an inbuilt mechanism called snapshots that tracks the changes on a table and helps build an SCD-2 history. …

Purpose This article will just give the details for implementing Iceberg on AWS Athena. Distributed databases or query engines like hive or athena don’t support ACID property. For example AWS athena is a query engine and files are stored on S3. it’s not possible to update the files using athena query…

Compliance regimes like GxP require teams to audit facts such as the following: Who accessed data? Which data did they access? When did they access this data? Were the data downloaded to an external device? Pre-requisites Your data are in Amazon S3 buckets You are monitoring the S3 buckets in CloudTrail …

Iceberg tables In a recent announcement, AWS introduced the general availability of a new type of table to their serverless interactive query offering — Athena. Iceberg is an open table format from the Apache Software Foundation that supports huge analytic datasets. Iceberg manages extensive collections of files as tables, and it supports…

tl;dr: Athena believes delegation can be transformative. But it’s hard. That’s why we’re cataloging our best delegation processes and practices in our new Playbooks and gathering them in our just-launched Playbook Library. Each delegation playbook is a blueprint to help your EA return even more time to you. Athena clients…