How to build a big data platform on AWS for 100 users for under $2 a month with Amazon Athena.

Simon Sugob
HireDevOps
Published in
2 min readNov 21, 2018

Do you often hear from your Customers?

“We need a platform allowing customers to access and visualize large stores of data at any time with machine learning pipelines. We want it developed quickly and run as lean as possible. And we swear, we won’t pay for anything our customers aren’t using.”

Before you take the shift to Redshift think of other solution — Amazon Athena. When you need a clean, quick to develop, easy to deploy and update, extremely robust and secure platform that’s where Athena comes to the rescue.

Launched in late 2016, Amazon Athena is a serverless, SQL-based query service for objects stored in S3. To use it you simply define a table that points to your S3 data file and fire SQL queries away! The price model of Athena is interesting. You are charged only for the amount of data scanned by each query and nothing more. Athena helped reduce per-user cost from over $74 a month to less than $0.02. Obviously, the costs of S3 and ancillary services increase this, but the analytics layer itself truly costs pennies.

Read a whole article by Jacob Richter: ”How we built a big data platform on AWS for 100 users for under $2 a month”. This is a perfect example of utilizing appropriate components in Serverless tech, using innovative thinking, to design something that exploits the platform to best effect.

Please find the link to the author’s article here: https://bit.ly/2DLLUyN

The article comes from https://www.hiredevops.org

--

--

Simon Sugob
HireDevOps

Senior DevOps @HireDevOps. Interested in #Kubernetes #AWS #IaC #Terraform #CDPipelines #DevSecOps #FaaS #CloudNative | hiredevops.org