toure/cloudstash

Backup and Restore solution for cloud platforms.

Cloudstash

Backup solution for distributed compute platforms.

• Ansible
• ReaR
• Magic, just a little

The goal of this role is to provide a means of protecting the data and configuration of a deployed cloud platform. This role will be centered around RHEL7+, RHOS, and Openshift (future releases.)

Tech

Cloudstash uses a number of open source projects to work properly:

• [Ansible] - software provisioning, configuration management, and application-deployment tool.
• [ReaR] - Linux bare metal disaster recovery solution

And of course Cloudstash itself is open source with a toure/cloudstash on GitHub.

Installation

Cloudstash requires Ansible v2.5+ to run.

Install:

$ git clone https://github.com/Toure/cloudstash.git
$ cd cloudstash

Edit the inventory file: (with your favortie editor)

Example Content:

[endpoint_nodes]
0.0.0.0  ansible_user=heat-admin
0.0.0.0  ansible_user=heat-admin

[undercloud]
0.0.0.0  ansible_user=stack

[hypervisor_nodes]
0.0.0.0  ansible_user=root

[nfs_server]
0.0.0.0

**nfs_server ip should correspond with the network which is addressable by the controller nodes.

Install packages on all nodes:

$ bash cloudstash.sh --install

Configure NFS Server on defined server node:

$ bash cloudstash.sh -s -e "server_setup=1"

Configure NFS Clients:

$ bash cloudstash.sh -c -e "client_setup=1"

Perform the first systems backup:

$ bash cloudstash.sh --backup

Generate a rescue image:

$ bash cloudstash.sh --rescue

Development

Want to contribute? Great! Please submit PRs with patches or open a bug as a feature request.

Todos

• Write Tests
• Add features which I couldn't think about.

License

Apache v2

Free Software, Hell Yeah!

cloudstash's Issues

Error installing package for ReaR

TASK [rear/setup : Install packages for ReaR] *********************************************************************************************************************************************************************
task path: /root/cloudstash/roles/rear/setup/tasks/main.yml:2
fatal: [controller-2]: FAILED! => {
"reason": "'msg' is not a valid attribute for a Task\n\nThe error appears to have been in '/root/cloudstash/roles/rear/setup/tasks/rear_install.yml': line 19, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- debug:\n ^ here\n\nThis error can be suppressed as a warning using the "invalid_task_attribute_failed" configuration"
}
fatal: [controller-1]: FAILED! => {
"reason": "'msg' is not a valid attribute for a Task\n\nThe error appears to have been in '/root/cloudstash/roles/rear/setup/tasks/rear_install.yml': line 19, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- debug:\n ^ here\n\nThis error can be suppressed as a warning using the "invalid_task_attribute_failed" configuration"
}
fatal: [controller-0]: FAILED! => {
"reason": "'msg' is not a valid attribute for a Task\n\nThe error appears to have been in '/root/cloudstash/roles/rear/setup/tasks/rear_install.yml': line 19, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- debug:\n ^ here\n\nThis error can be suppressed as a warning using the "invalid_task_attribute_failed" configuration"
}

Install ReaR only copies the local.conf to /etc/rear/local.conf

The jinja2 variables are not replaced when ReaR is configured.

[root@undercloud-0 ~]# cat /etc/rear/local.conf
ISO_PREFIX={{ ansible_hostname }}
OUTPUT=ISO
OUTPUT_URL=nfs://{{ nfs_server }}/{{ backup_mountpoint }}
BACKUP=NETFS
BACKUP_URL=nfs://{{ nfs_server }}/{{ backup_mountpoint }}
BACKUP_PROG_EXCLUDE=("${BACKUP_PROG_EXCLUDE[@]}" '/media' '/var/tmp' '/var/crash')
NETFS_KEEP_OLD_BACKUP_COPY=
BOOTLOADER=
GRUB_RESCUE=1

Update README.md to include extra options available in cloudstash.sh

The readme should reflect a few more example options to give the operator an insight on various scenarios.

cloudstash.sh --install excludes -t TAG as advance option

Trying to install the nfs server:
I executed bash cloudstash.sh --install -t server
Debuging a little bit, I found that the last ansible command is:
"ansible-playbook -vv playbooks/cloudstash_setup.yml -t install"

There is no sign of the -t server argument.

parse bridge interface for ip.

This functionality should be include to parse the correct interface in which we configure for the undercloud nfs server. This has to be set to insure that the correct IP/VLAN is used to communicate with the overcloud nodes.

#############################

• name: Get NFS Server IP
  hosts: undercloud
  gather_facts: true
  tasks:
  • set_fact:
    nfs_server_ip: "{{ item }}"
    when: "item.startswith('192.168.24')"
    with_items: "{{ ansible_all_ipv4_addresses }}"
  • debug: msg= "{{ nfs_server_ip }}"