zaidsasa/kubernetes-practice-environment

A Kubernetes practice cluster for CKA, CKAD, and CKS certifications using Vagrant and Ansible.

kubernetes-practice-environment's Issues

use only controlplane as ansible guest

Using controlplane as an ansible guest only, will lead for a increase for setup speed.

Reference: https://developer.hashicorp.com/vagrant/docs/provisioning/ansible_local#ansible-parallel-execution-from-a-guest

Remove hack tasks from ansible/roles/controlplane/tasks/install-calico.yaml

remove hack tasks from : ansible/roles/controlplane/tasks/install-calico.yaml

1. Install python package installer
2. install ansible python pre-requisites packages

send join.sh between vms instead of using .tmp shared folder

.tmp folder is a hacky way to transporting join.sh between vm's

transfering join.sh file between vm's can be done using a peer-to-peer connection such as ssh.

using ansible module to copy files will not currently work since we are using ansible_local.

CoreDNS is not working properly

After a running DNS verifications steps. it seems that the CoreDNS is not working as expected.

Reference: https://kubernetes.io/docs/tasks/administer-cluster/dns-debugging-resolution

Log:

kubectl logs -f -l k8s-app=kube-dns -n kube-system
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.11.1
linux/amd64, go1.20.7, ae2bbc2
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.11.1
linux/amd64, go1.20.7, ae2bbc2
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: Trace[1865396114]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231 (28-May-2024 09:26:50.461) (total time: 30060ms):
[INFO] plugin/kubernetes: Trace[555358322]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231 (28-May-2024 09:26:50.463) (total time: 30057ms):
Trace[555358322]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30045ms (09:27:20.508)
Trace[555358322]: [30.057302013s] [30.057302013s] END
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
Trace[1865396114]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30048ms (09:27:20.509)
Trace[1865396114]: [30.060042546s] [30.060042546s] END
[INFO] plugin/kubernetes: Trace[1298336724]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231 (28-May-2024 09:26:50.488) (total time: 30037ms):
Trace[1298336724]: ---"Objects listed" error:Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30020ms (09:27:20.508)
Trace[1298336724]: [30.037187505s] [30.037187505s] END
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: Trace[1913296934]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231 (28-May-2024 09:26:50.489) (total time: 30043ms):
Trace[1913296934]: ---"Objects listed" error:Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30018ms (09:27:20.508)
Trace[1913296934]: [30.043722966s] [30.043722966s] END
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/kubernetes: Trace[2131551246]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231 (28-May-2024 09:26:50.488) (total time: 30048ms):
Trace[2131551246]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30019ms (09:27:20.508)
Trace[2131551246]: [30.048818375s] [30.048818375s] END
[INFO] plugin/kubernetes: Trace[1498410255]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231 (28-May-2024 09:26:50.460) (total time: 30061ms):
Trace[1498410255]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30047ms (09:27:20.508)
Trace[1498410255]: [30.061616064s] [30.061616064s] END
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

make /etc/kubernetes/admin.conf as a variable

bump calico to v3.28.0

https://github.com/projectcalico/calico/releases/tag/v3.28.0

configure dependabot for detect requirements.txt update

depends on #41

use calico controller instead of operator.

IPBlock is generating duplicate IPs

IPBlock is not generating IP's properly when node count is bigger than 1.

replace hack with requirements.txt

hack task is to install pip and kubernetes.

bump dashboard to version 7.4.0

In order to bump the version to 7.4.0 we need to use kubernetes.core.helm

Dashboard releases: https://github.com/kubernetes/dashboard/releases

Bump calico 3.27.3

Bump calico 3.27.3

enable multicast DNS to all vms

we need to enable mDNS in order to resolve vm's by their hostnames.

example how to ping node01 from controlplane:

vagrant ssh controlplane
ping node01.local

bump kubernetes dashboard version from 7.4.0 to 7.5.0

Move base packages to cloudinit

The idea is to move bases packages outside of ansible

packages:

• pip
• crio
• kubelet
• kubeadm
• kubectl
• helm

folder creation:

• ~/.kube

add k8s dashboard as optional

Missing .kube directory in node machines

Node01 provision will fail since .kube directory in missing.