Comments (8)
Hi darold,
Could you please provide your comments .
from ora2pg.
Hi, with 64GB of memory you shoud not experiencing an OOM even with a higher DATA_LIMIT. What do you mean by "using OID datatype" are you talking about the --blob_to_lo
option? By default BLOB are translated into bytea by Ora2Pg.
When a table have BLOB and the parameter BLOB_LIMIT is set Ora2Pg will use it, so here you will export 5 row at a time which is low. What is the maximum size of a BLOB in this table?
from ora2pg.
And also what is the ora2pg command you are using?
from ora2pg.
Hi Darold,
The Maximum length of the BLOB is 3GB
Yes am using --blob_to_lo option and below is the command were used for export
nohup ora2pg -t COPY -o data_DOC_STATUS_CONTENTS.sql -b ${WORK_DIR}/${P_CODE}/data -c ${WORK_DIR}/${P_CODE}/config/ora2pg.conf -l ${LOG_1} -d --blob_to_lo &
from ora2pg.
I think first that you should use direct import to PostgreSQL and not output to file. You should also parallelize the export from Oracle using the -J
command line option provide that you have a column of NUMBER data type that has a unique constraints (PK or unique index) defined on this table.
from ora2pg.
Yes, that's right. But we can't import directly we have some network restriction on between the both datacenters so we're exporting to a local file and trying the --J option, but we're still getting the same problem. ORA-01062: define buffer any memory
when I trigger export , the export it self aborting with following error ORA-01062: define buffer any memory
from ora2pg.
I think the problem is not related to Ora2Pg but to Oracle, the OOM occurs at Oracle side. I don't know the Oracle version and the available memory on this server but you should look at Oracle side on what happen. You should also try to export using a WHERE clause in ora2pg.conf to extract a single row with a huge BLOB to see if this is the full extraction that has problem or just even a single line extraction reports an OOM.
from ora2pg.
That sounds good. I'll check the Oracle server end. Like you said, I'll try with a single export row.
from ora2pg.
Related Issues (20)
- ora2pg -c ora2pg.conf -t COPY -a tablename not working HOT 1
- Package name is shorter when referenced in CREATE TYPE HOT 4
- Package/Schema is missing in search_path HOT 1
- Unrecognized character in Ora2Pg/PLSQL.pm line 1237 HOT 1
- ORA-12505: TNS:listener does not currently know of SID given in connect descriptor HOT 2
- Problem with slow data migration speed. HOT 5
- Function JSON_ARRAYAGG does not get translated properly
- name of a column is a reserved word in postgresql HOT 3
- ORACLE_DSN doesnt recognized HOT 10
- support for MS SQL Server to PostgreSQL HOT 10
- bad table creation operator HOT 2
- There is no control for default values HOT 2
- Invalid timestamp format conversion HOT 2
- is this tools supports mysql 8 default authentication as I want to migrate database from mysql v8 to postgres HOT 2
- SQL queries selecting NEXVAL from the sequence in the trigger are not translated HOT 1
- DROP_FKEY happens even during --oracle_speed, when >1 table HOT 2
- error message : Unmatched ( in regex; marked by <-- HERE in m/\bg_grsamt( HOT 3
- SQL Server 2014 does not provide sys.indexes.auto_created column HOT 2
- issue using ora2pg conversion to postgresql for objects referred with mdsys.geomerty (specifically related to shapefiles) HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ora2pg.