Support configMaps

Rundeck Kubernetes Plugin

This project provides integration between Rundeck and Kubernetes. This project contains a number of providers allowing job writers to use steps to call various API actions in Kubernetes.

Use cases:

Create Kubernetes Deployments, Services and Jobs
Run ad hoc command executions inside Kubernetes containers.

Requirements

These plugins require the python kubernetes SDK to be installed on the rundeck server. For example, you can install it using pip install kubernetes.

The Python Kubernetes API client requires version 11 of the library. You can confirm it with python -m pip list | grep kubernetes.

Further information here: https://github.com/kubernetes-client/python.

Authentication for Tectonic Environments.

There is a pull request work for the kubernetes python SDK to support authenticating with the kubernetes API using OIDC (which is used by tectonic).

For now, you can install the kubernetes python SDK from this repo to have the OIDC support:

git clone --recursive https://github.com/ltamaster/python
cd python
python setup.py install

Build and Install

Run gradle build to build the zip file. Then, copy the zip file to the $RDECK_BASE\libext folder.

Authentication

By default, and if any authentication parameters are not set, the plugin will check the ~/.kube/config file to get the authentication parameters.

Otherwise, you can set the following parameters:

Kubernetes Config File Path: a custom path for the kubernetes config file
Cluster URL: Kubernetes Cluster URL
Kubernetes API Token: Token to connect to the kubernetes API
Verify SSL: Enable/Disable the SSL verification
SSL Certificate Path: SSL Certificate Path for SSL connections

Resource Model

This plugin allows getting the container pods from kubernetes as rundeck nodes.

Default attributes: List of key=value pairs, example: username=root
Custom Mapping: Custom mapping adding on the rundeck nodes, for example: nodename.selector=default:Name,hostname.selector=default:pod_id
Tags: List of tags. You can add static and custom tags, for example: tag.selector=default:image, tag.selector=default:status, kubernetes
Namespace Retrieve only pods from a desired namespace. (An empty value results in listing pods from all namespaces) For example: default will result on listing the pods on "default" namespace.
Field Selector: Filter the list of pods using a response's API fields. For further information check SDK docs here. For example: metadata.uid=123 will show the pod with uid 123.
Just Running Pods?: Filter by running pods

This plugin generates a list of default pod's attributes in order to reference them on the custom config parameters of the plugin (eg: default:status, default:image). The following list are the default available attributes:

default:pod_id: Pod ID,
default:host_id: Host ID,
default:started_at: started At,
default:name: Pod Name,
default:namespace: Pod namespace,
default:labels: Deployments labels,
default:image: Image,
default:status: Pod Status,
default:status_message: Pod Status message,
default:container_id: Container ID,
default:container_name: Container Name

For example, if you want to add a custom tag for the container's image name, use tag.selector=default:image on the Tags config attribute. Or if you want to define the hostname node attribute using the POD ID, use hostname.selector=default:pod_id on the Custom Mapping config attribute.

Node Executor

This plugin allows run commands/scripts to a container pod from rundeck.

Configurations:

Shell: Shell used on the POD to run the command. Default value: /bin/bash
Debug?: Write debug messages to stderr

File Copier

This plugin allows copy files from rundeck to a pod. For now just script and text files can be copied to a remote pod.

Configurations:

Shell: Shell used on the POD to run the command. Default value: /bin/bash
Debug?: Write debug messages to stderr

Workflow Steps

The following steps plugins allow you to deploy/un-deploy applications and run/re-run jobs on kubernetes. For example, you can create deployment, services, ingress, etc and update or delete those kubernetes resources.

Create / Update / Delete / Check / Wait a Deployment

These steps manage deployment resources, you can create, update or delete a deployment and check its status.

Also, you have a step to wait for a deployment to be ready when the deployment is created. These require that the deployment define a Readiness Probe (further information here)

Create / Update / Delete Services

These steps manage services resources, you can create, update or delete a service.

Create / Delete / Re-run Jobs

These steps manage services resources, you can create or delete a Job.

Also, you can re-run jobs that are already created. Kubernetes doesn't allow re-run jobs, so what this step does is get the job definition, delete it, and creating it again.

Generic Steps

These steps provide a generic way to create/delete resources on kubernetes using a yaml script. The resources that this plugin allows creating are:

Deployment
Service
Ingress
Job
StorageClass
PersistentVolume
PersistentVolumeClaim
Secret

	data = {}
	data["name"] = os.environ.get('RD_CONFIG_NAME')
	data["namespace"] = os.environ.get('RD_CONFIG_NAMESPACE')
	data["container"] = os.environ.get('RD_NODE_DEFAULT_CONTAINER_NAME')

	common.connect()

	try:
	v1 = client.CoreV1Api()
	ret = v1.read_namespaced_pod_log(
	namespace=data["namespace"],
	name=data["name"],
	container=data["container"],
	_preload_content=False
	)
	print(ret.read())

09:21:05	1. Watcher for ts-utils pod	rundeck-cc7776b7f-79gcdChecking job status ...
09:21:05		ERROR: kubernetes-wait-pod: Exception waiting for job: (401)
09:21:05		Reason: Unauthorized
09:21:05		HTTP response headers: HTTPHeaderDict({'Cache-Control': 'no-cache, private', 'Content-Length': '165', 'Audit-Id': '3b7692d2-d1f0-4420-90ce-9cdd8f3f802a', 'Content-Type': 'application/json', 'Date': 'Thu, 29 Oct 2020 09:21:05 GMT'})
09:21:05		HTTP response body: {
09:21:05		"kind": "Status",
09:21:05		"apiVersion": "v1",
09:21:05		"metadata": {
09:21:05
09:21:05		},
09:21:05		"status": "Failure",
09:21:05		"message": "Unauthorized",
09:21:05		"reason": "Unauthorized",
09:21:05		"code": 401
09:21:05		}
09:21:05
09:21:05
09:21:05		Failed: NonZeroResultCode: Script result code was: 1
09:21:05		[wf:5edf6ad6-ac7e-4ae7-9213-2298b35cd4b6] Step [2] did not run. start conditions: [(after.step.1 == 'true')], skip conditions: [(step.2.completed == 'true')]

09:13:24	1. Watcher for deployment	rundeck-cc7776b7f-79gcdERROR: kubernetes-model-source: Exception deleting deployment: (401)
09:13:24		Reason: Unauthorized
09:13:24		HTTP response headers: HTTPHeaderDict({'Cache-Control': 'no-cache, private', 'Audit-Id': 'a08a5dae-cdfa-4942-aa6d-9b01177fc624', 'Date': 'Thu, 29 Oct 2020 09:13:24 GMT', 'Content-Type': 'application/json', 'Content-Length': '129'})
09:13:24		HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Unauthorized","reason":"Unauthorized","code":401}
09:13:24
09:13:24
09:13:24
09:13:24		Failed: NonZeroResultCode: Script result code was: 1

13:23:20		1. Kubernetes / Job / Create	[workflow] Begin step: 1,NodeDispatch
13:23:20			1: Workflow step executing: StepExecutionItem{type='NodeDispatch', keepgoingOnSuccess=false, hasFailureHandler=false}
13:23:20			preparing for sequential execution on 1 nodes
13:23:20			Executing command on node: localhost, NodeEntryImpl{tags=[], attributes={nodename=localhost, hostname=localhost, osFamily=unix, osVersion=3.10.0-327.36.3.el7.x86_64, osArch=amd64, description=Rundeck server node, osName=Linux, username=rundeck, tags=}, project='null'}
13:23:20			[workflow] beginExecuteNodeStep(localhost): NodeDispatch: StepExecutionItem{type='NodeDispatch', keepgoingOnSuccess=false, hasFailureHandler=false}
13:23:20			[Kubernetes-Create-Job] step started, config: {debug=true, container_name=hello world Container, verify_ssl=false, image_pull_policy=Always, name=my job, namespace=default, api_version=batch/v1, job_restart_policy=Never, container_image=hello-world:latest, url=mylab-master01.mylab.lab, token=eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJkZWZhdWx0Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6ImRlZmF1bHQtdG9rZW4tenM5OHQiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoiZGVmYXVsdCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImI4YjAyMjRlLWY1NjctMTFlNy1hZjQ0LTAwNTA1NjhlNzU0NiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpkZWZhdWx0OmRlZmF1bHQifQ.b7gfoLkWCwH_7KeuyGcLqyW9kJTtfJzjePt887xGFWz468y3jhMxU_QeID49d1x4PMeEbx73G35I3vQ6s3Nn0mh5Hrg0pVsWiyd6x0fIdxW9bNpNuJsHD5oIbbhM-GXKaUBJ2Inwqc5tloXjYnh67Vb4P816xYPnPkaw_ejDuEEHc3LrS4SQpNoy22z_URELhYGpRBEmcGODZm_VFxq8jt72B5xED0AO5jBRFaCNQns95ZIvFB0IfKuUzIk2PN369Wx-th3UvaKfpfjhTBbeF4wc4X5XLcRjTGWeYklwNXB2cLxiPbDlBsDQsj8RW-gHZz7peFIOViDcR1wrEEJZ6w}
13:23:20			[Kubernetes-Create-Job] executing: [python, -u, /var/lib/rundeck/libext/cache/kubernetes-plugin-1.0.4/job-create.py]
13:23:20			DEBUG: kubernetes-model-source: Log level configured for DEBUG
13:23:20			DEBUG: kubernetes-model-source: Creating job
13:23:20			DEBUG: kubernetes-model-source: {'image_pull_policy': 'Always', 'name': 'my job', 'job_restart_policy': 'Never', 'namespace': 'default', 'container_name': 'hello world Container', 'container_image': 'hello-world:latest', 'api_version': 'batch/v1'}
13:23:20			DEBUG: kubernetes-model-source: new job:
13:23:21			DEBUG: kubernetes-model-source: {'api_version': 'batch/v1',
13:23:21			'kind': 'Job',
13:23:21			'metadata': {'annotations': None,
13:23:21			'cluster_name': None,
13:23:21			'creation_timestamp': None,
13:23:21			'deletion_grace_period_seconds': None,
13:23:21			'deletion_timestamp': None,
13:23:21			'finalizers': None,
13:23:21			'generate_name': None,
13:23:21			'generation': None,
13:23:21			'initializers': None,
13:23:21			'labels': None,
13:23:21			'name': 'my job',
13:23:21			'namespace': 'default',
13:23:21			'owner_references': None,
13:23:21			'resource_version': None,
13:23:21			'self_link': None,
13:23:21			'uid': None},
13:23:21			'spec': {'active_deadline_seconds': None,
13:23:21			'backoff_limit': None,
13:23:21			'completions': None,
13:23:21			'manual_selector': None,
13:23:21			'parallelism': None,
13:23:21			'selector': None,
13:23:21			'template': {'metadata': {'annotations': None,
13:23:21			'cluster_name': None,
13:23:21			'creation_timestamp': None,
13:23:21			'deletion_grace_period_seconds': None,
13:23:21			'deletion_timestamp': None,
13:23:21			'finalizers': None,
13:23:21			'generate_name': None,
13:23:21			'generation': None,
13:23:21			'initializers': None,
13:23:21			'labels': None,
13:23:21			'name': 'my job',
13:23:21			'namespace': None,
13:23:21			'owner_references': None,
13:23:21			'resource_version': None,
13:23:21			'self_link': None,
13:23:21			'uid': None},
13:23:21			'spec': {'active_deadline_seconds': None,
13:23:21			'affinity': None,
13:23:21			'automount_service_account_token': None,
13:23:21			'containers': [{'args': None,
13:23:21			'command': None,
13:23:21			'env': [],
13:23:21			'env_from': None,
13:23:21			'image': 'hello-world:latest',
13:23:21			'image_pull_policy': 'Always',
13:23:21			'lifecycle': None,
13:23:21			'liveness_probe': None,
13:23:21			'name': 'hello world Container',
13:23:21			'ports': None,
13:23:21			'readiness_probe': None,
13:23:21			'resources': None,
13:23:21			'security_context': None,
13:23:21			'stdin': None,
13:23:21			'stdin_once': None,
13:23:21			'termination_message_path': None,
13:23:21			'termination_message_policy': None,
13:23:21			'tty': None,
13:23:21			'volume_devices': None,
13:23:21			'volume_mounts': None,
13:23:21			'working_dir': None}],
13:23:21			'dns_config': None,
13:23:21			'dns_policy': None,
13:23:21			'host_aliases': None,
13:23:21			'host_ipc': None,
13:23:21			'host_network': None,
13:23:21			'host_pid': None,
13:23:21			'hostname': None,
13:23:21			'image_pull_secrets': None,
13:23:21			'init_containers': None,
13:23:21			'node_name': None,
13:23:21			'node_selector': None,
13:23:21			'priority': None,
13:23:21			'priority_class_name': None,
13:23:21			'restart_policy': 'Never',
13:23:21			'scheduler_name': None,
13:23:21			'security_context': None,
13:23:21			'service_account': None,
13:23:21			'service_account_name': None,
13:23:21			'share_process_namespace': None,
13:23:21			'subdomain': None,
13:23:21			'termination_grace_period_seconds': None,
13:23:21			'tolerations': None,
13:23:21			'volumes': None}}},
13:23:21			'status': None}
13:23:21			Traceback (most recent call last):
13:23:21			File "/var/lib/rundeck/libext/cache/kubernetes-plugin-1.0.4/job-create.py", line 208, in
13:23:21			main()
13:23:21			File "/var/lib/rundeck/libext/cache/kubernetes-plugin-1.0.4/job-create.py", line 197, in main
13:23:21			namespace=data["namespace"]
13:23:21			File "/usr/local/lib/python2.7/dist-packages/kubernetes/client/apis/batch_v1_api.py", line 58, in create_namespaced_job
13:23:21			(data) = self.create_namespaced_job_with_http_info(namespace, body, **kwargs)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/kubernetes/client/apis/batch_v1_api.py", line 143, in create_namespaced_job_with_http_info
13:23:21			collection_formats=collection_formats)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/kubernetes/client/api_client.py", line 321, in call_api
13:23:21			_return_http_data_only, collection_formats, _preload_content, _request_timeout)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/kubernetes/client/api_client.py", line 155, in __call_api
13:23:21			_request_timeout=_request_timeout)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/kubernetes/client/api_client.py", line 364, in request
13:23:21			body=body)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/kubernetes/client/rest.py", line 266, in POST
13:23:21			body=body)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/kubernetes/client/rest.py", line 166, in request
13:23:21			headers=headers)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/urllib3/request.py", line 70, in request
13:23:21			**urlopen_kw)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/urllib3/request.py", line 148, in request_encode_body
13:23:21			return self.urlopen(method, url, **extra_kw)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/urllib3/poolmanager.py", line 321, in urlopen
13:23:21			response = conn.urlopen(method, u.request_uri, **kw)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 589, in urlopen
13:23:21			conn = self._get_conn(timeout=pool_timeout)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 251, in _get_conn
13:23:21			return conn or self._new_conn()
13:23:21			File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 212, in _new_conn
13:23:21			strict=self.strict, **self.conn_kw)
13:23:21			File "/usr/local/lib/python2.7/dist-packages/urllib3/connection.py", line 125, in init
13:23:21			_HTTPConnection.init(self, args, *kw)
13:23:21			TypeError: init() got an unexpected keyword argument 'assert_hostname'
13:23:21			[Kubernetes-Create-Job]: result code: 1
13:23:21			Failed: NonZeroResultCode: Script result code was: 1

rundeck-plugins / kubernetes Goto Github PK

kubernetes's Introduction

Rundeck Kubernetes Plugin

Requirements

Authentication for Tectonic Environments.

Build and Install

Authentication

Resource Model

Node Executor

File Copier

Workflow Steps

Create / Update / Delete / Check / Wait a Deployment

Create / Update / Delete Services

Create / Delete / Re-run Jobs

Generic Steps

kubernetes's People

Contributors

Stargazers

Watchers

Forkers

kubernetes's Issues

File "/opt/rundeck/libext/cache/kubernetes-plugin-1.0.9/create-from-yaml.py", line 6, in

here's the logs :

Traceback (most recent call last):

gradle build

Recommend Projects

Recommend Topics

Recommend Org