Managing Kubernetes clusters using Rancher [20Sept2021]

---

 

Here is the Environment for me. You may go with single worker node 

Created Tuesday 07 September 2021

Rancher node: Centos 7 (better to keep this separate from cluster nodes), flavor: m3.xsmall
Master Node: Centos 7, m3.xsmall
Worker Node-1: Centos 7, m3.xsmall
Worker Node-2: Centos 7, m3.xsmall

Both Master and Work Node have allow-all security group attached
Minimal ports required are 80/TCP, 443/TCP

[src: https://rancher.com/docs/rancher/v2.x/en/quick-start-guide/deployment/quickstart-manual-setup/

Common installation

1. Install Docker

• Create the daemon file manually. This is also because of some conflict in University's Openstack Environment.

        sudo mkdir -p /etc/docker

        sudo tee /etc/docker/daemon.json <<EOF
	{
	  "exec-opts": ["native.cgroupdriver=systemd"],
	  "log-driver": "json-file",
	  "log-opts": {
	    "max-size": "100m"
	  },
	  "storage-driver": "overlay2",
	  "storage-opts": [
	    "overlay2.override_kernel_check=true"
	  ],

"default-address-pools": [{"base":"172.80.0.0/16","size":24}]

	}
	EOF

• Now run this command. It will add the official Docker repository, download the latest version of Docker, and install it:

curl -fsSL https://get.docker.com/ | sh

• After installation has completed, start the Docker daemon:

sudo systemctl start docker

ERROR if docker is unable to start, try to check the /etc/docker/daemon.json file

• Verify that it’s running:

sudo systemctl status docker

• enable docker to start on boot:

sudo systemctl enable docker

• To run docker commands with non-root privileges

sudo groupadd docker
sudo usermod -aG docker $USER
newgrp docker

Rancher node

1. Enter the following command to run rancher container

sudo docker run -d --restart=unless-stopped -p 80:80 -p 443:443 --privileged rancher/rancher

2. Go to the web browser and hit https://<SERVER_IP_Rancher_Node>
3. Follow the wizard for initial setup

Once it is done, you should be able to see the dashboard with local as the cluster name

Create a new cluster

src: https://rancher.com/docs/rancher/v2.5/en/quick-start-guide/deployment/quickstart-manual-setup/

1. Go to the browser and access Rancher Dashboard
2. From the dashboard, click on Create
3. Click on Custom
4. Give Cluster Name as cluster-1 and skipp other infos
5. Click on Next
6. Select etcd , Control Plane , Worker
7. Select the Registration command
   1. The registration command should look like:

sudo docker run -d --privileged --restart=unless-stopped --net=host -v /etc/kubernetes:/etc/kubernetes -v /var/run:/var/run rancher/rancher-agent:v2.6.0 --server https://172.17.90.86 --token bflxwjlsvsrtbnvp8nj5xq82xx2sr5npjsxm82mbtdcfkc9g65x5d8 --ca-checksum f9bc8c23fff67155023fde69026ec83a77f632657f1049fd6ca9ae5732cf59d3 --etcd --controlplane --worker

8. Go to master node terminal and execute the registration command

At this point you need to wait for few minutes...

9. After this, you will see in the browser that 1 New node has registered.
10. Now click on Done
11. Repeat Step 6 to get the registration command for worker node. For worker node you just need to select Worker

Deleting a node

[src: https://rancher.com/docs/rancher/v2.5/en/cluster-admin/cleaning-cluster-nodes/]
Deleting Docker Containers, Images, and Volumes

Based on what role you assigned to the node, there are Kubernetes components in containers, containers belonging to overlay networking, DNS, ingress controller and Rancher agent. (and pods you created that have been scheduled to this node)

To clean all Docker containers, images and volumes:

docker rm -f $(docker ps -qa)
docker rmi -f $(docker images -q)
docker volume rm $(docker volume ls -q)

Clean the related directories

sudo rm -rf /etc/ceph \
	   /etc/cni \
	   /etc/kubernetes \
	   /opt/cni \
	   /opt/rke \
	   /run/secrets/kubernetes.io \
	   /run/calico \
	   /run/flannel \
	   /var/lib/calico \
	   /var/lib/etcd \
	   /var/lib/cni \
	   /var/lib/kubelet \
	   /var/lib/rancher/rke/log \
	   /var/log/containers \
	   /var/log/kube-audit \
	   /var/log/pods \
	   /var/run/calico

It is now good to reboot the VM with following command:

sudo reboot

-That's all

Installation of Kubernetes cluster using "kubeadm"- Final verison [16Sept2021]

Following steps are tested on 16 Sept 2021

Difference between Classification and Clustering in Machine Learning

	Classification	Clustering
What is it?	Given a set of historical/old data along with their class name and a set of new data, classification is the process of assigning each new data with class name that is obtained from the old/historical data.	Given a set of samples/data, clustering is the process of grouping the data based on their similarities and the patterns of the data.
Type of input data	Set of data with label/class name	Only the data set. No labeling is required.
Input	A set of samples or data A set of classes	A set of samples
Output	Class name of each new sample based on the classes of existing samples	Groupism of set of samples based on the data patterns.  Each sample will be assigned with a group/label/class name. Number of classes can be known.
Number of classes	Number of classes are known	Unknown number of classes.  (number of classes can be known after clustering process is over)
Learning type	Supervised learning	Unsupervised learning
Algorithms	Decision tress Bayesian classifier SVM	K-mean Expectation maximization
Dependencies	Depend on training data	no training data is required. No prior knowledge is required.

[src] : 

https://stackoverflow.com/questions/5064928/difference-between-classification-and-clustering-in-data-mining

http://www.differencebetween.net/technology/difference-between-clustering-and-classification/