Updates about the 10-hour outage for AWS Lambdas using aws-serverless-express

Now fixed by AWS! We’re updating here info about the Dec 13th outage of the relevant Lambdas.

Aviad Mor
Lumigo
Published in
2 min readDec 14, 2018

--

As many of you probably know, an AWS Lambda outage took place yesterday (Thursday, Dec 13th). The outage affected all lambdas using the aws-serverless-express, running the Node.js 8.10 runtime.

As far as we can tell based on Lumigo’s monitoring platform as well as feedbacks from AWS and our customers, the issue is now resolved. Lumigo is actively monitoring the issue and waiting for AWS formal root cause analysis.

The impacted lambdas (including both JS and typescript), received an “aws-serverless-express connection error” for every invocation during the outage.
The outage lasted for around 10 hours, depending on the region.

aws-serverless-express connection error

From the data we collected, it happened in several regions, including:

  • us-east-2
  • eu-west-1
  • ap-southeast-1
  • ap-northeast-1

You can see examples of the errors (and the responsiveness of the good people of AWS, namely Brett Andrews) in the github thread.

We’ll update this post once we’ll have additional info.

Did you experience the downtime? Share any info you have in the comments, especially about the impact or any workaround that worked for you!

--

--