AutoScaling Ec2 Instances based on CPU usage using Terraform

AutoScaling Ec2 Instances based on CPU usage using Terraform

In this Article we will explore How to scale in and scale down EC2 instances based on there CPU utilization using Autoscaling and Loadbalancer

The source Code is available in

github.com/Jaffarterraform786/cloudwatch

you can just insert your access key and secret key to Run the Code.

Auto Scaling Groups :

Autoscaling Group also allows you to dynamically control your server pool size — increase it when your web servers are processing more traffic or tasks than usual, or we can decrease or Terminate Instances when Traffic is very less.

Figure :AutoScaling

Launch Configuration:

AWS Launch Configuration is a template containing all instance settings to apply to each new launched by Auto Scaling Group instance.

Figure : Aws Launch Configuration

Lets create an Loadbalancer ELB .

A Loadbalancer basically Receives the traffic from clients, shuffles the traffic and sends the traffic to the right instance.

USER_DATA:

The user-data option is filled with a simple bash-script, which installs the apache web server and puts the instance’s local IP address to the index.html file, so we can see it after the instance is up and running.

LIFECYCLE

Lifecycle is a special instruction, which is used in declaring how new launch configuration rules applied during update. We’re using CREATE_BEFORE_DESTROY here to create new instances from a new launch configuration before destroying the old ones. This option used during rolling deployments..

Lets specify health_check configuration, which determines when Load Balancer should transition instances from healthy to unhealthy state and back depending on its ability to reach HTTP port 80 on the target instance.

Lets specify 2 Subnets, where our Load Balancer will look for (listener configuration) launched instances and turned on CROSS ZONE LOADBALANCING feature, so we could have our instances in different Availability Zones.

Figure ELB

Lets define a security Group

SECURITY GROUP:

  1. A security group acts a layer of security around EC2 instances.

  2. we can create 5 security groups for an instance.

  3. we can specify only allow rules , not deny rules.

Figure security group

Lets launch autoscaling group:

  • There will be minimum one instance to serve the traffic.

  • Auto Scaling Group will be launched with 2 instances and put each of them in separate Availability Zones in different Subnets.

  • Auto Scaling Group will get information about instance availability from the ELB.

  • We’re set up collection for some Cloud Watch metrics to monitor our Auto Scaling Group state.

  • Each instance launched from this Auto Scaling Group will have Name tag set to web.

Figure autoscaling Group

Auto scaling policies:

aws_autoscaling_policy defines how AWS should change Auto Scaling Group instances count in case of aws_cloudwatch_metric_alarm.

cooldown option is needed to give our infrastructure some time (300 seconds) before increasing Auto Scaling Group again.

Figure Autoscaling policies

aws_cloudwatch_metric_alarm is a straightforward alarm, which will be fired, if the total CPU utilization of all instances in our Auto Scaling Group is greater or equal threshold (60% CPU utilization) during 120 seconds.

Here we’re decreasing Auto Scaling Group size by one instance every 300 seconds if its total CPU utilization is less or equals 10%

Lets Do Terraform Plan to provision the resources.

Figure Resources Launched.

As the desired capacity is 2 we can see two EC2 instnaces Launched in console.

Figure: Initially 2 instances Launched

Figure : out of 2 instances 1 shutting Down

We can see 1 instance is shutting down.

This is because of the Cloud Watch alarm , Here we’re decreasing Auto Scaling Group size by one instance every 300 seconds if its total CPU utilization is less or equals 10%.

Figure :Alarm that caused Termination of an Instance.

Figure :Cloudwatch Alarm for cpu utilization<10 percent

Conclusion:

In this Article we have seen how to set up a dynamic Auto Scaling Group and Load Balancer to distribute traffic to your instances in several Availability Zones with cloudwatch Metrics.

Credits : jaffer shaikh

I am Sunil kumar, Please do follow me here and support #devOps #trainwithshubham #github #devopscommunity #devops #cloud #devoparticles #trainwithshubham

sunil kumar

Shubham Londhe

Connect with me over linkedin : linkedin.com/in/sunilkumar2807