This is the 3rd post in the Serverless messaging series.
[POST #3] Event Failures (and Retries) with AWS Serverless Messaging Services
Everything fails, all the time — Dr. Werner Vogels, CTO, Amazon.com
The serverless architecture has the flexibility to have independently isolated micro-services that can run, scale, and sustain on their own. Although this can make the overall environment hard to manage (observe) where thousands of events are flowing through.
Let’s take this…
Serverless computing, in general, is now considered a rapid way to build modern cloud-native applications. Like every major design systems in the past decades, the Serverless has also gone through a number of changes and improvements over time.
It has been only 6 years since AWS launched the Lambda service and this year, by far, has seen some major improvements. Lambda alone can do so little, but the thriving eco-system of services (integrations and event-emitters) is helping the overall Serverless Computing on AWS to cater to a vast variety of use cases.
This was one of the quotes from Andy…
This is the 2nd post in the Serverless communications series.
re:Invent 2020 UPDATE: AWS Lambda has changed the billing duration from 100ms to 1ms 🙌 . Check the full update here: https://aws.amazon.com/about-aws/whats-new/2020/12/aws-lambda-changes-duration-billing-granularity-from-100ms-to-1ms/
[POST #2 ] PAY per USE can derail your Serverless (dream) budget
Monitoring tells you whether the system works. Observability lets you ask why it’s not working.
Serverless applications are all about EVENTS. Events drive the whole system. One of the best advantages of using serverless architecture is that we can extend…
This is a multi-part series, wherein I will show various AWS Compute services like EC2, ECS, Fargate, and EKS to run Docker containers. We will use a number of other AWS services like CodeCommit, CodeBuild, CodePipeline along the way.
Note: We will not be looking at Docker Networking, Storage, Swarm and Services, Replicas, Load Balancer part in this post. I will cover those in upcoming articles.
In a nutshell, it looks like this. For full reference visit Containers on AWS.
Note: I sat for the Database Specialty Beta Exam in Jan 2020 and cleared it.
Yes, it took me a long time to “pass” all of them, never planned to do ALL but it turned out to be a good learning journey.
We are what we repeatedly do.
In this part, we will use the Lambda Layers along with the popular Serverless Framework. Serverless Framework is a good option to write production level serverless applications for multiple cloud providers. You can manage your code pretty well and can manage the deployment cycle easily too.
The above repo has the full working application with Serverless Framework and Lambda Layers.
Let’s get started.
We will be using a simple hello-world app along with
moment as our layer.
$ sls create --template aws-nodejs --path serverlesslayers
To start with our
handler.js file is very simple and we are not adding any piece…
This article only shows how to use Layers manually, and not suitable for the production grade.
In Part-2, I will cover how we can use this along with Serverless Framework for production grade application.
If you are writing AWS Lambda-based services frequently and haven’t yet used the Layers, spare couple of hours and give it a try now.
At first, Lambda Layers may look complicated to start with. But it’s very simple to integrate. Let’s take a simple example: You have written a simple Node.js application which made up of 5 lambda functions, each of these functions uses MomentJS for…
We recently build a full-serverless video/media distribution application for one of our clients. The app uses a combination of Serverless Framework, AWS S3, Lambda, API Gateway, X-Ray, Lambda Layers, Pinpoint, AppSync and a bunch of other services.
Now that it has been running we started adding more features for analytics and customer engagement like sending periodic push notifications and reminders.
Previous we had done the same using CloudWatch Events, where we schedule a bunch of Lambdas for different tasks and send out emails, notifications in a pipeline. However, that means more than a few moving parts, we need to manage…
S3 Select provides capabilities to query a JSON, CSV or Apache Parquet file directly without downloading the file first. You can think this as a limited version of Amazon Athena, which allows you to query multiple files in a bucket.
We have all the data stored on S3 which is a fully managed storage service. S3 Select is part of the S3 service only, and we do not need to provision anything additionally to run in-place-queries. We can call the queries either from the S3 Console of using AWS SDK.
In this example, we will be querying a CSV file…
I recently had a conversation with a colleague regarding various AWS services for BigData and I gave an example of how Kinesis can be used to ingest real-time data with analytics capabilities. Through the conversation, I realized that though it is easy to explain conceptually, it is slightly difficult to understand put things together when you start using it.
Before you start using any of the AWS services, make sure you go through the service price model. …
AWS Serverless Hero, 12x AWS, 2x GCP, CKAD, Docker Certified, Founder @ AppGambit