This is the 3rd post in the Serverless messaging series.

[POST #1] Select the right Event-Routing service from Amazon EventBridge, Amazon SNS, and Amazon SQS

[POST #2 ] PAY per USE can derail your Serverless (dream) budget

[POST #3] Event Failures (and Retries) with AWS Serverless Messaging Services

Everything fails, all the time — Dr. Werner Vogels, CTO,

Loose-coupling comes with a price

The serverless architecture has the flexibility to have independently isolated micro-services that can run, scale, and sustain on their own. Although this can make the overall environment hard to manage (observe) where thousands of events are flowing through.

Let’s take this…

Serverless computing, in general, is now considered a rapid way to build modern cloud-native applications. Like every major design systems in the past decades, the Serverless has also gone through a number of changes and improvements over time.

It has been only 6 years since AWS launched the Lambda service and this year, by far, has seen some major improvements. Lambda alone can do so little, but the thriving eco-system of services (integrations and event-emitters) is helping the overall Serverless Computing on AWS to cater to a vast variety of use cases.

This was one of the quotes from Andy…

This is the 2nd post in the Serverless communications series.

re:Invent 2020 UPDATE: AWS Lambda has changed the billing duration from 100ms to 1ms 🙌 . Check the full update here:

[POST #1] Select the right Event-Routing service from Amazon EventBridge, Amazon SNS, and Amazon SQS

[POST #2 ] PAY per USE can derail your Serverless (dream) budget

Monitoring tells you whether the system works. Observability lets you ask why it’s not working.

Serverless and Event-Driven Services

Serverless applications are all about EVENTS. Events drive the whole system. One of the best advantages of using serverless architecture is that we can extend…

This is a multi-part series, wherein I will show various AWS Compute services like EC2, ECS, Fargate, and EKS to run Docker containers. We will use a number of other AWS services like CodeCommit, CodeBuild, CodePipeline along the way.

Note: We will not be looking at Docker Networking, Storage, Swarm and Services, Replicas, Load Balancer part in this post. I will cover those in upcoming articles.

AWS Compute Services for Docker

  • Running Docker on EC2 (this one)
  • Running Docker on ECS
  • Running Docker on Fargate
  • Running Docker on EKS

In a nutshell, it looks like this. For full reference visit Containers on AWS.

Note: I sat for the Database Specialty Beta Exam in Jan 2020 and cleared it.

Yes, it took me a long time to “pass” all of them, never planned to do ALL but it turned out to be a good learning journey.

We are what we repeatedly do.

Usual questions that I get over Email/LinkedIn

  • How did you prepare for X certification, and Y certification?
  • Did you get any benefits by clearing the X certification?
  • Hey bro, I want to clear AWS certifications, help me pls.
  • I want to take X certification, but don’t know where/how to start!
  • Will I get this job if I pass X…

In this part, we will use the Lambda Layers along with the popular Serverless Framework. Serverless Framework is a good option to write production level serverless applications for multiple cloud providers. You can manage your code pretty well and can manage the deployment cycle easily too.

The above repo has the full working application with Serverless Framework and Lambda Layers.

Let’s get started.

Create a Serverless App

We will be using a simple hello-world app along with moment as our layer.

$ sls create --template aws-nodejs --path serverlesslayers

To start with our handler.js file is very simple and we are not adding any piece…

This article only shows how to use Layers manually, and not suitable for the production grade.

In Part-2, I will cover how we can use this along with Serverless Framework for production grade application.

If you are writing AWS Lambda-based services frequently and haven’t yet used the Layers, spare couple of hours and give it a try now.

At first, Lambda Layers may look complicated to start with. But it’s very simple to integrate. Let’s take a simple example: You have written a simple Node.js application which made up of 5 lambda functions, each of these functions uses MomentJS for…

This is NOT how we build right now. We just type /build_XXX in our Slack and somehow it manages to build the app magically :) :)

We recently build a full-serverless video/media distribution application for one of our clients. The app uses a combination of Serverless Framework, AWS S3, Lambda, API Gateway, X-Ray, Lambda Layers, Pinpoint, AppSync and a bunch of other services.

Now that it has been running we started adding more features for analytics and customer engagement like sending periodic push notifications and reminders.

Previous we had done the same using CloudWatch Events, where we schedule a bunch of Lambdas for different tasks and send out emails, notifications in a pipeline. However, that means more than a few moving parts, we need to manage…

S3 Select provides capabilities to query a JSON, CSV or Apache Parquet file directly without downloading the file first. You can think this as a limited version of Amazon Athena, which allows you to query multiple files in a bucket.

How is this Serverless!!

We have all the data stored on S3 which is a fully managed storage service. S3 Select is part of the S3 service only, and we do not need to provision anything additionally to run in-place-queries. We can call the queries either from the S3 Console of using AWS SDK.


In this example, we will be querying a CSV file…

I recently had a conversation with a colleague regarding various AWS services for BigData and I gave an example of how Kinesis can be used to ingest real-time data with analytics capabilities. Through the conversation, I realized that though it is easy to explain conceptually, it is slightly difficult to understand put things together when you start using it.

Before you start using any of the AWS services, make sure you go through the service price model. …

Dhaval Nagar

AWS Serverless Hero, 12x AWS, 2x GCP, CKAD, Docker Certified, Founder @ AppGambit

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store