jskov/backup

Encrypted backup of photo/music files

backup's Issues

Backup files should contain /ofhowmany

[Security] Workflow run-tests.yml is using vulnerable action actions/checkout

The workflow run-tests.yml is referencing action actions/checkout using references v1. However this reference is missing the commit a6747255bd19d7a757dbdda8c654a9f84db19839 which may contain fix to the some vulnerability.
The vulnerability fix that is missing by actions version could be related to:
(1) CVE fix
(2) upgrade of vulnerable dependency
(3) fix to secret leak and others.
Please consider to update the reference to the action.

Include m5sum for comparison to jotta files

Failed to write backup with space in name

$ java -jar ~/bin/backup-1.2.0.jar comics/bundle-top\ cow/ /opt/_rips/_backup/top-cow
..
Failed to run /opt/_rips/_backup/top-cow/comics/comics-bundle-top cow.sh, returned 2
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-01.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-02.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-03.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-04.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-05.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-06.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-07.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-08.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-09.crypt: No such file or directory
/bin/cat: comics-bundle-top: No such file or directory
/bin/cat: cow-10.crypt: No such file or directory
gpg: decrypt_message failed: Unknown system error
/bin/tar: This does not look like a tar archive
/bin/tar: Exiting with failure status due to previous errors

Backup should reject to fill target disk up

    at dk.mada.backup.cli.CliMain.main(CliMain.java:255)
        Suppressed: java.io.IOException: This archive contains unclosed entries.
                at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.finish(TarArchiveOutputStream.java:448)
                at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.close(TarArchiveOutputStream.java:318)
                at dk.mada.backup.MainExplore.packDir(MainExplore.java:103)
                ... 14 more                                 
        Suppressed: dk.mada.backup.gpg.GpgEncrypterException: GPG IO failed
                at dk.mada.backup.gpg.GpgEncryptedOutputStream.throwOnFailure(GpgEncryptedOutputStream.java:175)
                at dk.mada.backup.gpg.GpgEncryptedOutputStream.close(GpgEncryptedOutputStream.java:151)
                at dk.mada.backup.MainExplore.packDir(MainExplore.java:103)
                ... 14 more                                                                                                                                    
        Caused by: dk.mada.backup.gpg.GpgEncrypterException: Failed to copy data from GPG to output stream      
                at dk.mada.backup.gpg.GpgEncryptedOutputStream.copyToUnderlyingStream(GpgEncryptedOutputStream.java:248)
                at dk.mada.backup.gpg.GpgEncryptedOutputStream.lambda$startGpgBackgroundProcess$1(GpgEncryptedOutputStream.java:209)
                at java.base/java.lang.Thread.run(Thread.java:833)                                                                                             
        Caused by: java.io.IOException: No space left on device                                                                                                
                at java.base/sun.nio.ch.FileDispatcherImpl.write0(Native Method)                                        
                at java.base/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)                                     
                at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:132)                                   
                at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:97)                                                                                           
                at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:67)                                                                                           
                at java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:288)                                 
                at java.base/java.nio.channels.Channels.writeFullyImpl(Channels.java:74)                                    
                at java.base/java.nio.channels.Channels.writeFully(Channels.java:96)                              
                at java.base/java.nio.channels.Channels$1.write(Channels.java:171)   
                at java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
                at java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:95)
                at dk.mada.backup.splitter.SplitterOutputStream.write(SplitterOutputStream.java:78)
                at java.base/java.io.FilterOutputStream.write(FilterOutputStream.java:87)
                at dk.mada.backup.gpg.GpgEncryptedOutputStream.copyToUnderlyingStream(GpgEncryptedOutputStream.java:241)
                ... 2 more                                  
        Suppressed: java.io.IOException: No space left on device
                at java.base/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
                at java.base/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
                at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:132)
                at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:97)
                at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:67)                                                                                           
                at java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:288)                                                                                                                                                                                                                                       
                at java.base/java.nio.channels.Channels.writeFullyImpl(Channels.java:74)                                                                                                                                                                                                                                      
                at java.base/java.nio.channels.Channels.writeFully(Channels.java:96)
                at java.base/java.nio.channels.Channels$1.write(Channels.java:171)           
                at java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
                at java.base/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142)
                at java.base/java.io.FilterOutputStream.close(FilterOutputStream.java:182)                  
                at dk.mada.backup.splitter.SplitterOutputStream.closeCurrentFile(SplitterOutputStream.java:121)
                at dk.mada.backup.splitter.SplitterOutputStream.close(SplitterOutputStream.java:128)
                at dk.mada.backup.MainExplore.packDir(MainExplore.java:103)
                ... 14 more                           
Caused by: java.io.IOException: Broken pipe                 
        at java.base/java.io.FileOutputStream.writeBytes(Native Method)
        at java.base/java.io.FileOutputStream.write(FileOutputStream.java:349)
        at java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:123)
        at java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
        at java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:127)
        at dk.mada.backup.gpg.GpgEncryptedOutputStream.write(GpgEncryptedOutputStream.java:116)
        at org.apache.commons.compress.utils.CountingOutputStream.write(CountingOutputStream.java:62)
        at org.apache.commons.compress.utils.FixedLengthBlockOutputStream$BufferAtATimeOutputChannel.write(FixedLengthBlockOutputStream.java:91)
        at org.apache.commons.compress.utils.FixedLengthBlockOutputStream.writeBlock(FixedLengthBlockOutputStream.java:259)
        at org.apache.commons.compress.utils.FixedLengthBlockOutputStream.maybeFlush(FixedLengthBlockOutputStream.java:169)
        at org.apache.commons.compress.utils.FixedLengthBlockOutputStream.write(FixedLengthBlockOutputStream.java:206)
        at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.write(TarArchiveOutputStream.java:713)
        at dk.mada.backup.MainExplore.copyToTar(MainExplore.java:264)
        ... 29 more                                         

Verification failures after 1.0.5

Not sure why it happens. Only sometimes. Failing paths, or something.
Maybe because gpg credentials not entered, because could not reproduce next day after making a new backup.

egrep: warning: egrep is obsolescent; using grep -E