clagomess/dbbackup

dbbackup's Issues

Está fazendo dump de VIEW

Caso ocorrido com oracle

Problemas ao rodar o JAR

Comando:

java -jar dbbackup.jar -db POSTGRESQL \
    -ope GET \
    -url jdbc:postgresql://xxxx \
    -user xxx \
    -pass xxx \
    -schema xxx \
    -table tbl_veiculo_marca \
    -table tbl_veiculo_modelo

Resultado:

INFO  2020-01-24 16:33:44 - Tabelas para exportação:
WARN  2020-01-24 16:33:44 - br.dbbackup.sgbd.Sgbd
java.nio.file.NoSuchFileException: file:/home/claudio/DESENV_NODE/fipe-siscon/dbbackup.jar!/sql/postgresql_tabcolumns.sql
	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
	at java.nio.file.Files.newByteChannel(Files.java:361)
	at java.nio.file.Files.newByteChannel(Files.java:407)
	at java.nio.file.Files.readAllBytes(Files.java:3152)
	at br.dbbackup.core.Resource.getByteArray(Resource.java:15)
	at br.dbbackup.core.Resource.getString(Resource.java:19)
	at br.dbbackup.sgbd.Postgresql.getSqlTabColumns(Postgresql.java:18)
	at br.dbbackup.sgbd.Sgbd.startDump(Sgbd.java:43)
	at br.dbbackup.main.Main.main(Main.java:67)
Exception in thread "main" java.nio.file.NoSuchFileException: file:/home/claudio/DESENV_NODE/fipe-siscon/dbbackup.jar!/sql/postgresql_tabcolumns.sql
	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
	at java.nio.file.Files.newByteChannel(Files.java:361)
	at java.nio.file.Files.newByteChannel(Files.java:407)
	at java.nio.file.Files.readAllBytes(Files.java:3152)
	at br.dbbackup.core.Resource.getByteArray(Resource.java:15)
	at br.dbbackup.core.Resource.getString(Resource.java:19)
	at br.dbbackup.sgbd.Postgresql.getSqlTabColumns(Postgresql.java:18)
	at br.dbbackup.sgbd.Sgbd.startDump(Sgbd.java:43)
	at br.dbbackup.main.Main.main(Main.java:67)

Melhorar performance PUMP com batch Insert

See: https://viralpatel.net/blogs/batch-insert-in-java-jdbc/

Ordem de colunas conforme banco

Criar funcionalidade com totalizador de registros. Ideal para verificar se deu tudo certo

Não está incrementando corretamento o contador no momento do dump

INFO  2020-04-27 17:04:04 - # DUMP Table: "public.oauth_access_tokens" (21/48)
INFO  2020-04-27 17:04:04 - QTD Registro: 0
INFO  2020-04-27 17:04:04 - # DUMP Table: "public.oauth_clients" (21/48)
INFO  2020-04-27 17:04:04 - QTD Registro: 0
INFO  2020-04-27 17:04:04 - # DUMP Table: "public.oauth_refresh_tokens" (21/48)
INFO  2020-04-27 17:04:04 - QTD Registro: 0
INFO  2020-04-27 17:04:04 - # DUMP Table: "public.oauth_scopes" (21/48)
INFO  2020-04-27 17:04:04 - QTD Registro: 0
INFO  2020-04-27 17:04:04 - # DUMP Table: "public.objeto_atendimento" (21/48)
INFO  2020-04-27 17:04:04 - QTD Registro: 62
INFO  2020-04-27 17:04:04 - QUERY: SELECT id_objeto_atendimento, no_objeto_atendimento FROM public.objeto_atendimento
INFO  2020-04-27 17:04:04 - FILE: dump/021_public.objeto_atendimento.sql

Criar possibilidade de dump simples de estrutura de dados

Too many open files

RN  2019-02-16 18:36:50 - br.dbbackup.sgbd.Sgbd
java.io.FileNotFoundException: dump/lob/lob_b4af9a71f4c84ce5b624ccdc65b2567b.bin (Too many open files)
	at java.base/java.io.FileOutputStream.open0(Native Method)
	at java.base/java.io.FileOutputStream.open(FileOutputStream.java:299)
	at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:238)
	at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:127)
	at br.dbbackup.core.LobWriter.write(LobWriter.java:21)
	at br.dbbackup.sgbd.Postgresql.formatColumn(Postgresql.java:88)
	at br.dbbackup.sgbd.Sgbd.startDumpProcess(Sgbd.java:114)
	at br.dbbackup.sgbd.Sgbd.startDump(Sgbd.java:56)
	at br.dbbackup.main.Main.main(Main.java:64)
Exception in thread "main" br.dbbackup.core.DbbackupException: dump/lob/lob_b4af9a71f4c84ce5b624ccdc65b2567b.bin (Too many open files)
	at br.dbbackup.main.Main.main(Main.java:74)

Quando não for marcado a opção lob, não fazer query da coluna

Quando houver erro de insert, não está fechando aplicação com exit code

INFO  2019-02-14 22:04:59 - ROWS: 437767
Pump   0% [>                                                                                                                             ]      0/437767 (0:00:00 / ?) WARN  2019-02-14 22:04:59 - br.dbbackup.sgbd.Sgbd
java.sql.SQLIntegrityConstraintViolationException: ORA-01400: não é possível inserir NULL em ("DB_SISCON"."TBL_ARQUIVO"."DES_ARQUIVO")

	at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:447)
	at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
	at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:951)
	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:513)
	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:227)
	at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
	at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:195)
	at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:1036)
	at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1336)
	at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1916)
	at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1878)
	at oracle.jdbc.driver.OracleStatementWrapper.execute(OracleStatementWrapper.java:318)
	at br.dbbackup.sgbd.Sgbd.pumpScript(Sgbd.java:197)
	at br.dbbackup.sgbd.Sgbd.startPumpProcess(Sgbd.java:165)
	at br.dbbackup.sgbd.Sgbd.startPump(Sgbd.java:60)
	at br.dbbackup.main.Main.main(Main.java:67)
Exception in thread "main" br.dbbackup.core.DbbackupException: ORA-01400: não é possível inserir NULL em ("DB_SISCON"."TBL_ARQUIVO"."DES_ARQUIVO")

	at br.dbbackup.main.Main.main(Main.java:74)
Pump   0% [>                                                                                                                             ]      0/437767 (0:00:04 / ?) ^C

Criar opção de definir query de tabela

Problemas com identificadores - ORACLE

INFO  2019-02-14 20:20:57 - # DUMP Table: "DB_SISCON.VIW_TOTAL_REGISTROS_INDICADOR" (77/101)
INFO  2019-02-14 20:20:57 - QTD Registro: 10
INFO  2019-02-14 20:20:57 - QUERY: SELECT label, value FROM DB_SISCON.VIW_TOTAL_REGISTROS_INDICADOR
WARN  2019-02-14 20:20:57 - br.dbbackup.sgbd.Sgbd
java.sql.SQLSyntaxErrorException: ORA-00904: "VALUE": identificador inválido

	at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:447)
	at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
	at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:951)
	at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:513)
	at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:227)
	at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
	at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:195)
	at oracle.jdbc.driver.T4CStatement.executeForDescribe(T4CStatement.java:876)
	at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1175)
	at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1296)
	at oracle.jdbc.driver.OracleStatement.executeQuery(OracleStatement.java:1498)
	at oracle.jdbc.driver.OracleStatementWrapper.executeQuery(OracleStatementWrapper.java:406)
	at br.dbbackup.sgbd.Sgbd.startDumpProcess(Sgbd.java:102)
	at br.dbbackup.sgbd.Sgbd.startDump(Sgbd.java:54)
	at br.dbbackup.main.Main.main(Main.java:64)
Exception in thread "main" br.dbbackup.core.DbbackupException: ORA-00904: "VALUE": identificador inválido

	at br.dbbackup.main.Main.main(Main.java:74)