Analyze VPC flow logs
VPC flow logs are an important part of AWS to help troubleshoot connectivity and security issues and to make sure that security group access is in the right place.
The logs capture important information about the IP traffic to and from network interfaces, subnets and VPCs in the AWS infrastructure. They are used to monitor security by tracking traffic reaching and leaving the resources(instance, databases, etc) in the AWS infrastructure.
The logs provide network flow visibility in the dynamic cloud which helps in tightening security and understand network performance.
And of course, keep the SecOps team off your back.
Security
The flow logs provide a number of avenues to tighten your security and make sure everything is connecting as needed.
- They can be used to boost data collection to help in correlate and to strengthen security insights.
- Help you create baselines of your standardized network activities which in turn helps in identifying abnormal events.
- Identifying potential botnet activity is easier by comparing time-stamps and periodicity of certain traffic. You can also directly look for known botnet connections to interfaces and block them.
- Identify and block vulnerability scans by checking for ping sweeps, port scans and other malicious activities associated to discover weaknesses in the network.
- You can also improve troubleshooting of performance problems.
- Optimize connectivity inside your organization for developers, testers and ITOps teams.
Performance
The VPC flow logs help in identifying latencies, establish performance baselines and tweak apps as needed.
It provides granular information like traffic flow duration & latencies, bytes sent which in turn helps in identifying performance issues quickly. Having quantifiable data from the logs helps in providing a better user experience.
VPC flow logs are employed to monitor internal application services. The applications build on the microservices architecture heavily rely on internal traffic to communicate.
Note: Understanding VPC flow logs also provides an opportunity to save bandwidth costs like Mikuláš did. You can read more about it here.
Analyzing VPC Flow Logs
Enabling them is the easy part but analyzing VPC flow logs is just another ball game. There are multiple ways of analyzing the VPC flow logs but most of them are expensive in terms of bandwidth and time needed to set them up. Below are certain ways to set up your dashboard.
Conclusion
AWS has provided these logs to improve network visibility and tackle security, performance, and cost.
P.s. — We recently opened the registrations to the closed beta for visualizing VPC flow logs in a virtual environment.
Originally published at blog.totalcloud.io on March 12, 2018.
