Skip to main content

Rancher for Microservices : Load Balancing and Scaling Containers.

In my previous post, we saw how easy it is to set up Kubernetes cluster using Rancher. Once you have a cluster up and running, next step is to deploy your microservices on the cluster. In this post, we’ll look at how to deploy, run and scale a docker image on your cluster. We’ll also look at setting up an L7 load balancer to distribute traffic between multiple instances of your app.

Let’s create a simple HTTP service which returns server hostname & current version of the binary (hardcoded). I’ve used go-lang for this, below is code snippet which returns hostname and service version.
Simple HTTP Server, return app version & hostname.

All it does is, returns a string "App Version 2.0 running on host: <hostname>", once deployed it will return container hostname.

Next step is to dockerize our service by generating a docker image and push it to DockerHub (or your private Docker registry), below is Dockerfile I used to dockerize this service.

Dockerfile: run "docker build -t ravirdv/app:v1.0 ."

Running this will compile our service and generate a docker image on local machine. Version number is generally used to tag docker image so we’ve tagged it as v1.0. 

We can push this image to DockerHub using following command : docker push

You can access this image from, there are two tags i.e. 1.0 & 2.0

Now that we've our shiny app on the docker repository, we can deploy it on our cluster via Rancher.

On Rancher, select your cluster, namespace and click on "Deploy", specify service name, docker image and hit the "Launch" button to start a container.

It will show the workload as active once the container is started. Now since our app is HTTP service running on port 8080, we need to expose this port to the external world. In order to do this, we got few options, first one is to bind container’s port 8080 to a random port on a node, another option is to attach an L7 load balancer to route traffic to our container. L7 Load balancer approach give you more flexibility. By default, Rancher deploys nginx to handle L7 traffic and it runs on port 80. Rancher also allows you to specify a hostname or generate a subdomain with your app name. In this case, it generated app.tutorial.<localip> and point its A record to out cluster IP.

You can map a path with this container and the port on which the container is listening. It takes around 20 to 30 seconds for it to generate hostname, you should be able to get a response from the endpoint once generated.

Now that we've got it up and running, let's start a curl script to periodically make HTTP call to this service.

As you can see, we have got service version and container hostname as HTTP response, if you look closely all responses have the same hostname. That's expected since we've got only one container running.

Now let's look at how scaling container works. Since we've mapped our workload with the L7 load balancer, it should automatically take care of distributing traffic among our containers. You can edit the workload and increase the number of containers.

Now looking at same curl script output, we can see requests distributed between two containers as response contains two different hostnames.

Now we have a service which scales, its easy since our service doesn't have any state. I'll cover more on persistence storage for services like databases.

I hope this post helps you deploying simple stateless services on your cluster, please leave a comment in case something is unclear. In next post, we'll look into how Rancher handles upgrades and rollback.


Popular posts from this blog

Getting Started with Rancher & Kubernetes

During my time working at Azoi (a startup), I was responsible for maintaining Gitlab for my team along with various other self-hosted internal services. When I first setup Gitlab in 2013, it was quite a task, as setting it up would involve configuring various services using provided scripts and a lot of luck. Fortunately, I found Bitnami Gitlab package to make that process easier. However initial setup is one thing and keeping up with the latest releases was a nightmare.

Fast forward to 2016, I joined eInfochips as Solutions Consultant. Where one of my responsibilities was to modernize development workflow and encourage DevOps culture. It made sense to use Gitlab specially for Gitlab-runner and since this was a fresh setup, I explored few options to setup Gitlab, I found that Gitlab monthly releases were now published as Docker images. So I decided to use Gitlab docker image to host gitlab-ce internally. This time around, the experience was very different, initial setup and upgrading…

Get Double Speed BSNL Broadband Simple Trick High Speed Broadband


Step 1: Make sure that your modem is in Bridge Mode.

Step 2: Make a new Virtual Machine and install Windows XP on it.

Step 3 : Create a new text file and type following command:

rasdial "Broadband Connection" username password

username = ur broadband username
password = ur broadband password
Broadband Connection = Name of the Connection you use to connect, you can find it in Control Panel -> Network Connections

save it as "connect.bat"

double click on that file to check if it connects to the internet or not.

Step 5:
Copy that file to XP running in Virtual Machine.

Step 6:

Click Start -> Programs -> Accessories -> System -> Task Scheduler

select connect.bat as application to run and then set the time to run that app (same time in both systems*)

Time should be 2 minutes from current time so you dont have to wait too much...

*Very Important if connect.bat doesnt run at same time then only 1 XP would be connected to internet.

Complete Step 6 on both host and …