AWS Glue Tutorial

How to start with AWS Glue and Athena

George Pipis
Jan 12 · 5 min read
Image for post
Image for post
aws

Introduction

Create an S3 Bucket

Image for post
Image for post

Discovering the Data

nycitytaxi
Image for post
Image for post
s3://aws-tc-largeobjects/DEV-AWS-MO-Designing_DataLakes/week3/
Image for post
Image for post
Image for post
Image for post

Transform the data from CSV to Parquet

nytaxi-csv-parquet
s3://glue-aa60b120/admin
s3://glue-aa60b120/temp
s3://glue-aa60b120/data
Image for post
Image for post
Image for post
Image for post
nytaxiparquet
s3://glue-aa60b120/data
Image for post
Image for post

Analyze the data with Amazon Athena

Select * From nycitytaxi.data limit 10;
s3://glue-aa60b120/sql
Image for post
Image for post

Reference

The Startup

Medium's largest active publication, followed by +773K people. Follow to join our community.

George Pipis

Written by

Data Scientist @ Persado | Co-founder of the Data Science blog: https://predictivehacks.com/

The Startup

Medium's largest active publication, followed by +773K people. Follow to join our community.

George Pipis

Written by

Data Scientist @ Persado | Co-founder of the Data Science blog: https://predictivehacks.com/

The Startup

Medium's largest active publication, followed by +773K people. Follow to join our community.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store