Apache Iceberg built-in support in AWS Athena Intro In the previous post, I experimented “Create Table” with Apache Iceberg in AWS Athena. AWS: Athena: Experiment Apache Iceberg Table Type — Create Table Apache Iceberg built-in support in AWS Athenamedium.com In this post, I will experiment CRUD — INSERT, SELECT, UPDATE, and DELETE and check the content of newly created files in the S3 path. Create Table without Partition

Apache Iceberg built-in support in AWS Athena Intro Three things in Apache Iceberg + AWS Athena got my attention. AWS Athena supports SQL based CRUD ( INSERT, SELECT, UPDATE, DELETE ) on Apache Iceberg. There is a way to compact ( re-write ) small files that can be created by multiple…

While building DBT models with DBT Athena, I got this error. Intro While building a DBT model with DBT Athena adapter, I got this error. NOT_SUPPORTED: Unsupported Hive type: json And also, I got the similar error when I use Apache Iceberg Table Format. NOT_SUPPORTED: Type not supported for Iceberg: json …

S3 incomplete multipart upload would cause high bill. TL;DR; Set a lifecycle that deletes (or aborts) “incomplete multipart upload” to prevent being charged by AWS for the useless storage usage. Intro In the previous post, I shared the inconsistency I noticed in AWS S3 bucket storage metrics between the “S3 bucket metric”…

upgrading to the latest Athena Query Engine V3 Improvements in V3 Faster runtime, lower cost There are four main improvements. Faster query performance by scanning less data Lowering cost in Athena by scanning less data Reduced query planning time from reduced Glue API overhead Faster query performance by better integration with the Apache…

unable to find where what caused the issue. Intro Note: I still don’t know what caused the inconsistency in the S3 total bucket size. Once I get the update, I will update this post. Noticed high bucket size On the S3 bucket metrics of AWS Console, I noticed a higher bucket size than it should…

some pairings I got from a Facebook post. I got the screenshot from a Facebook post. I haven’t tried to pair wine and cheese. Most of times, I drink wine alone or drink it with foods. Since I have no idea in paring wine and cheese, this example can be one I can follow and try. Cabernet Sauvignon with Sharp Cheddar Merlot with Feta Pinot Noir with Mozzarella Chardonnay with Brie Sauvignon Blanc with Fontina

lots of problems and one of ways to see them continuing from previous post. BS-don’t read: walking into people. see and find problems to solve I have been in an isolated spaces. walked out and started looking around.medium.com I don’t think this world is NOT a heaven, so there have to be problems. ( hmm well, maybe even the heaven might have problems as well ) One categorization I thought about was

I have been in an isolated spaces. walked out and started looking around. Walking out from where I am and walking toward where people live; see and find the problems that I want to solve BS-don’t read: define the problem or solve the problem? who I want to be?medium.com While I walked with my wife after breakfast, I shared my thought that I wrote…