ruiztulio/backupws

A simple set of python scripts to make an Odoo 8.0 backup using oerplib

backupws's Issues

Add gz compression method

Sometime ins more important the speed of the generated backup than the size, ie when we need to create a testdb:

• Bakcup main instance
• Copy file to test server
• Restore it
• Deactivate it
• Remove or keep it untill next iteration

The the compression process can take about 10 minutes using bz2, but about the half using gz

Make scripts compatible with dockerpy > 1.2.0

The most importante is this related to execute method.

Andh check that all the others functions and commands are still compatible

Detach checkout

When a Head has been setted to point to a commit, it can not be recognized by function "reference", here:

https://github.com/ruiztulio/backupws/blob/develop/get_branches_info.py#L28

because it is detached (the symbolic reference doesn't point to a branch).

Error when the instance has not filestore

This occurs when the comprressed backup has not filestore folder. In such case just give the warn and restore the database

No origin error

When trying to collect a branch without "origin" remote, using branches.py it seems to fail. No error is reported from gitpython but inner information seems to be unnaccesible or unexisting.

In the previous image: Branch "docker-runbot" (last git branch) doesn't have a remote origin. It is the only branch without "origin" and is the one with 'path' missing.

Pep Issues

Utils and other files contain some pep issues that need to be fixed.

Check if docker-py and docker versions matchs

http://i.imgur.com/m7mWMEV.png

Change config dict

Databse config dict must be changed and added the container name/id or the odoo config file in order to refactor the code and remove a lot of duplicated and unnecesary code

Problems with branches.py

• When building a new instance with deployv the script in charge of loading the branches from branches.json always attempts to git restore --hard even if no commit is specified resulting in "unknown revision or path not in the working tree." error.
• Also when specifying a branch from a repo with a specific commit but that repo exists in the image with a different commit, while trying to save the new branch in the same path as the branch in the image I get "fatal: Could not parse object '1dfd8c5f1fe5ad506fd99768ca1a27335772fe64'". Only if I try to save the new branch in the same path as the old branch, if I try different paths everything goes fine.
• Lastly, even if all the branches are cloned successfully I keep getting the log message "WARNING - Repo %s NOT LOADED"

FIX README

Here:

https://github.com/ruiztulio/backupws#using-docker-container

It is not a docker container if we're using odoo config file.

No requirements.txt

This is needed for obvious reasons, because the are some no stantad packages

Deactivate needs to be refactored

As all other commands deactivate have to be in a proper function and the main command only have to parse the parameters and call the proper funcitions

Refactor deactivate.py

Refactor and pylint

Create a replace command

Some times we need to replace a database with a newer one, but with thesse commands you have to drop it manually first and then create the new one.

It is better in a separate command to avoy any mistake with the parameters so if you replace it is with the explicit intention of doing so.

Replace_db fails when the filestore folder exists

In this case the folder must be deleted an replaced with new one

Changing filestore owner

This error is shown after moviing filestore when trying to change the fs folder owner:

Better error handling when the /tmp partition or dir is out of space

We need to handle this in a better way and cleanup everything after the error

Better debug logging when deactivating a db

In debug leven this is shown:

It'd be better if more verbose

Check readme

We need to be sure that the readme file is updated with the necessary help to use the new commands (backup and restore from docker container and deactivate)

ConfigArgParse

Some of the scripts are still using Argparse. They all must import configargparse

Checks before decompressing files

All conection and configuration parameters needs to be checked before decompressing files. Sometimes after 5 ~10 minutes decompressing thow an error because of some wrong parameters.

Test db with docker params

We should create a similar command to test_db but using the docker env vars instead of WS

Could be executed like:

python test_db_.py -d database_name_or_prefix -f dcker_name_or_id -b /path/to/backup.tar.bz2

Clone Bug

When a repo is cloned by first time, it should remove the target path if it exists and clone it again.