unskript/awesome-cloudops-automation

Cloud-ops automation runbooks that are ready to use. Build your own automations using the hundreds of drag and drop actions included in the repository. Built on Jupyter Notebooks, our automation platform jumpstarts your SRE RunBook creation. 😎 published by the unSkript community.

awesome-cloudops-automation's Issues

GCP Lego: Filter untagged GCP compute instances

Implement a GCP lego for listing all untagged compute instances.

You should be able to find the corresponding API in the GCP Docs

The reference AWS implementation within unSkript can be found here

GCP Lego: Delete an object from Cloud Storage (bucket)

Implement a GCP lego for delete an object from a given bucket.

You should be able to find the corresponding API in the GCP Docs

GCP Lego: List all public buckets in project

Implement a GCP lego to list all public buckets in GCP Cloud Storage (all projects if project is unspecified)

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Filter GCP compute instances by VPC

Implement a GCP lego for listing all compute instances with a given tag.

You should be able to find the corresponding API in the GCP Docs

The reference AWS implementation within unSkript can be found here.

GCP Lego: Disable encryption on a Cloud Storage Bucket

Implement a GCP lego for disabling encryption on GCP Cloud Storage Bucket.

You should be able to find the corresponding API in the GCP Docs

GCP Lego: remove role from group

Implement a GCP lego for removing a role from a group.

You should be able to find the corresponding API in the GCP Docs

Include More AWS Legos

Is your feature request related to a problem? Please describe.
Include More AWS Legos to cover EC2, S3, ECR and EKS services.

Describe the solution you'd like
More Legos for AWS Services would definitely be useful for future
Runbooks. It is good to have such Legos.

Describe alternatives you've considered
N/A

Additional context
N/A

GCP Lego: Resize a GKE cluster

Implement a GCP lego for resize a GKE cluster

You should be able to find the corresponding API in the GCP Docs

GCP Lego:Create Bucket

Implement a GCP lego to create a bucket.

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Delete FileStore Instance

Implement a GCP lego to delete filestore instance.

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Filter GCP compute instances by tag

Implement a GCP lego for listing all compute instances with a given tag.

You should be able to find the corresponding API in the GCP Docs

The reference AWS implementation within unSkript can be found here.

GCP Lego: Stop Compute Instances

Implement a GCP lego for stopping compute instances.

You should be able to find the corresponding API in the GCP Docs

The reference AWS implementation within unSkript can be found here

Runbook EC2-Disk-Cleanup

Describe the bug
The Runbook EC2-Disk-Cleanup.ipynb is not shown properly in the Github File Browser.

However, this Runbooks opens properly when opened using the Link in the Docker.

To Reproduce
Steps to reproduce the behavior:

1. Navigate to the Code
2. Click on AWS Folder -> EC2-Disk-Cleanup.ipynb

you will see the issue.

Expected behavior
Runbook should open like any others that are opened.

Screenshots

Desktop (please complete the following information):

• OS: Mac OSX
• Browser Safari
• Version 16.0 (17614.1.25.9.10, 17614)

Smartphone (please complete the following information):
N/A

Additional context
Add any other context about the problem here.

GCP Lego: Scale FileStore Instance capacity

Implement a GCP lego for scale filestore instance capacity

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Update instance labels on a FileStore

Implement a GCP lego for scale filestore instance capacity

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Edit FileStore instance capacity

Implement a GCP lego for scale filestore instance capacity

You should be able to find the corresponding API in the GCP Docs

GCP Lego: delete a group

Implement a GCP lego for deleting a group

You should be able to find the corresponding API in the GCP Docs

Kubernetes Runbook: Kube API Error budget burn

Is your feature request related to a problem? Please describe.
A higher-than-expected percentage of the operations kube-apiserver is performing are erroring. Since random errors are inevitable, kube-apiserver has a “budget” of errors that it is allowed to make before triggering this alert. It will be good to have a runbook to execute the standard set of steps whenever this happens.

Describe the solution you'd like
Prometheus has a runbook available here for this particular issue: https://runbooks.prometheus-operator.dev/runbooks/kubernetes/kubeapierrorbudgetburn/

GCP Lego: Add user to group

Implement a GCP lego for add a user to group in GCP

You should be able to find the corresponding API in the GCP Docs

Kubernetes Runbook: Kubelet has too many pods

Is your feature request related to a problem? Please describe.
Kubelets have a configuration that limits how many Pods they can run. The default value of this is 110 Pods per Kubelet, but it is configurable. It will be great to have a runbook that detects when Kubelet has more than desired capacity of pods and mitigates the issue.

Describe the solution you'd like
Here's a Prometheus runbook for this: https://runbooks.prometheus-operator.dev/runbooks/kubernetes/kubelettoomanypods/

GCP Lego: List nodes in GKE cluster

Implement a GCP lego for list nodes in a GKE cluster

You should be able to find the corresponding API in the GCP Docs

GCP Lego: add role to group

Implement a GCP lego for adding a new role to a group.

You should be able to find the corresponding API in the GCP Docs

GCP connector support

Add new folder and basic GCP lego

GCP Lego: Add role to service-account

Implement a GCP lego for adding a new role to a user.

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Schedule a VM instance to start or stop

Implement a GCP lego for schedule compute instances to start or stop.

You should be able to find the corresponding API in the GCP Docs

The reference AWS implementation within unSkript can be found here

GCP Lego: Restart Compute Instances

Implement a GCP lego for restarting compute instances.

You should be able to find the corresponding API in the GCP Docs

The reference AWS implementation within unSkript can be found here

GCP Lego: Create a new service-account

Implement a GCP lego for creating a new user in GCP

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Get Filestore instance info

Implement a GCP lego for get info for a filestore instance

You should be able to find the corresponding API in the GCP Docs

GCP Lego: delete a service-account

Implement a GCP lego for deleting a user

You should be able to find the corresponding API in the GCP Docs

Redis Lego: Find large keys in redis

Write a lego that locate large keys in Redis (size is a given parameter)

GCP Lego: Fetch an object from Cloud Storage (bucket)

Implement a GCP lego fetch an object from a Cloud Storage bucket.

You should be able to find the corresponding API in the GCP Docs

AWS Lego: create an AMI in given regions

AMI is region specific, but often times we need the AMI to be available in multiple regions.
Create a lego that replicates an AMI to given regions (all if none is specified).

Kubernetes Runbook: Kube Node not ready

Is your feature request related to a problem? Please describe.
A runbook to check if Kube Node is ready or not and if it is not ready, print the reason for it not being ready.

Describe the solution you'd like
Here's the Prometheus runbook for this particular issue: https://runbooks.prometheus-operator.dev/runbooks/kubernetes/kubenodenotready/

GCP Lego: GKE node-pool update

Implement a GCP lego for updating a node-pool in a running GKE cluster

You should be able to find the corresponding API in the GCP Docs

GCP Lego: remove role from user

Implement a GCP lego for removing a role from a user.

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Create a new group

Implement a GCP lego for creating a new group in GCP

You should be able to find the corresponding API in the GCP Docs

Kubernetes Runbook: kubelet down

Is your feature request related to a problem? Please describe.
A runbook to diagnose and mitigate the kubelet down issue.

Describe the solution you'd like
Here's a Prometheus runbook for this: https://runbooks.prometheus-operator.dev/runbooks/kubernetes/kubeletdown/

GCP Lego: Describe a GKE cluster

Implement a GCP lego for list nodes in a GKE cluster

You should be able to find the corresponding API in the GCP Docs

AWS Lego: Take a snapshot of an RDS instance

Write a lego that takes a snapshot of an RDS instance to a given S3 bucket

GCP Lego: Enable encryption on Cloud Storage bucket

Implement a GCP lego for enabling encryption on a Cloud Storage bucket.

You should be able to find the corresponding API in the GCP Docs

Kubernetes Runbook: Kubernetes Persistant Volume filling up

Is your feature request related to a problem? Please describe.
There can be various reasons why a volume is filling up. A runbook that will cover generic reasons for volumes that are legitimately filling and generic mitigations for specific issues.

Describe the solution you'd like
Here's the runbook by Prometheus which does this: https://runbooks.prometheus-operator.dev/runbooks/kubernetes/kubepersistentvolumefillingup/

GCP Lego: remove user from group

Implement a GCP lego for removing a user from a group

You should be able to find the corresponding API in the GCP Docs

Create a Github Workflow that runs pylint for changed python files

Is your feature request related to a problem? Please describe.
The Github Workflow that currently is checked in runs pylint on all python file. This can be improved to run the pylint on changed files only, this would reduce the Github workflow run minutes.

What is to be done?

• Enhance the existing workflow so it runs pylint on changed py files
• Make this as the pre-check which should pass to open a Pull Request

GCP Lego: list GKE node-pools

Implement a GCP lego for list node-pools in a GKE cluster

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Upload files

Implement a GCP lego to create an object in a given bucket (object will be populated from given data (string))

You should be able to find the corresponding API in the GCP Docs

GCP Lego: GKE node-pool rollback

Implement a GCP lego for rollback a node-pool upgrade in a GKE cluster

You should be able to find the corresponding API in the GCP Docs

Kubernetes Runbook: Kubernetes Scheduler down

Is your feature request related to a problem? Please describe.
A runbook to identify, diagnose and possibly mitigate the Kube Scheduler down issue.

Kubernetes Runbook: Kube API Down

Is your feature request related to a problem? Please describe.
A runbook to analyze the state of Kube API every few minutes and run diagnosis as well as remediation or send an alert whenever Kube API is down.

Describe the solution you'd like

• https://runbooks.prometheus-operator.dev/runbooks/kubernetes/kubeapidown/

GCP Lego: Create a new filestore instance

Implement a GCP lego for creating a new filestore instance

You should be able to find the corresponding API in the GCP Docs

GCP Lego: Get List of Buckets

Implement a GCP lego for list all buckets in a region (all regions if region is unspecified).

You should be able to find the corresponding API in the GCP Docs

The reference AWS implementation within unSkript can be found here