Serverless — Cloud Custodian setup on AWS Lambda
Cloud Custodian is CapitalOne’s open source product for managing your cloud. It provides various functionalities such as:
- Cost Management
You can read more about this tool at CapitalOne’s developer website
This blog will explain how to setup a simple tag-compliance policy using cloud custodian on AWS lambda making it completely serverless. This policy will check for specific tag on EC2 instances and if absent, it will perform the defined action , in this case STOP the instance.
- AWS Account
- IAM access on the AWS account to create policies, roles and user
- If using Windows, you need either virtual machine or docker setup on your machine where linux VM or container can be run. If using linux/unix, nothing to do.
Lambda function requires access to perform action on EC2 instances. This can be achieved by attaching an IAM role to this lambda function. If you don’t know how to create an IAM role, read How to create IAM role .
Create and IAM role “custodian-tag-compliance-role” and grant AmazonEC2FullAccess policy to this role.
To create lambda function from your local machine, you need programmatic access on AWS. For this, create and IAM user “custodian-bot” and grant the following permissions/policies:
Create programmatic access for this user. This will provide you with access key and secret key.
Copy the ARN of this IAM user and add in the trust relationship of the IAM role created before(custodian-tag-compliance-role)
Install Cloud Custodian:
If you are using Windows OS on your local machine, you need to have either one of the following:
- Virtual Machine installed to run linux
- Docker installed to run linux container
Once you have either of the above, switch to the linux environment and install cloud custodian. In order to install and execute cloud custodian, you need to have python and pip installed. If you do not have either of them, install and then proceed further.
Set the environment variables with the access key & secret key of the user and the default region.
Install cloud custodian using pip
pip install c7n
To check the installation version, use the following command:
Once the installation is complete, create the policy document. Cloud custodian policy is a YAML document which defines the policies and actions to be taken on cloud resources. Further reading on how to write a policy can be found at policies.
The policy we will be using is :
- name: owner-tag-compliance
schedule: rate(1 hour)
Schedule a resource that does not meet tag compliance policies
to be stopped in four days.
- State.Name: running
- "tag:Owner": absent
This policy will create a lambda function with role Custodian-tag-compliance-role and a cloudwatch rule which will trigger the lambda function every 1 hour and check EC2 resources for the following filters:
- The instance is in running state
- The “Owner” tag is absent
Instances matching this criteria will be stopped.
Save the file with the name policy.yml
Run the following command to create the lambda function to execute the policy , the cloudwatch rule for the schedule event.
custodian run -s . policy.yml
This lambda function will run every hour and check for the filters. If intances are found with the filters, it will STOP them. To test this function you can go to the AWS lambda console and trigger the function manually with the default test event.
If you want to see various commands with custodian,
Organizations can use Custodian to manage their AWS environments by ensuring compliance to security policies, tag…capitalone.github.io
cloud-custodian - Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to…github.com