Comments (3)
Any suggestion on what we can do? The importer now uses opencsv by default which allows multi-line entries in quotes.
from batch-import.
Minimally some amount of pitfall documentation. While I admit it is a common thing to CSV parsing, I didn't see anything about quotation in the readme, I assumed it was unsupported/not a concern until it caused a problem.
Given the insistence towards tab (^I) field-separation (and newline record separation), before I dove into the source, I generally assumed tokenization would be performed at the line and tab level, and that generally tabs and newlines would not be accepted as a character contained therein (at least not without explicit per-character escaping)
If it is the aim to support inline tabs/new lines through quoting, that should probably be documented. Or more aggressively, perhaps a warning should be logged when such are encountered.
Really the main problem was that this happened within the first 10000 records, so I had no output beyond a usage note and "Using existing configuration file", and couldn't tell if anything was happening at all until I attached a debugger
from batch-import.
Just wanted to say I ran into this as well, and it also took quite a big of debugging to figure it out, so I'm with @donaldguy re: pitfall documentation.
I also agree that Iif you're doing a batch-import, it is perfectly reasonable to assume that individual rows / entries are new-line delimited (many other massive import tools do this), so maybe there's away to turn that "feature" off in opencsv.
Otherwise, thanks for the great tool!
from batch-import.
Related Issues (20)
- Make Chunker.BUFSIZE a configuration option HOT 1
- Index lookup in relationship file throws NumberFormatException HOT 1
- Cannot connect to graphdb created by batch-import tool in Windows OS HOT 3
- NumberFormatException when importing relationships file HOT 1
- Rename master branch to 1.9 HOT 1
- Slow Import / 2G nodes file HOT 2
- Import Error HOT 1
- Error running batch_importer_22 HOT 3
- No relations input
- How can I know which line is it crashing on? HOT 1
- View graph in Neo4j Browser after importing HOT 3
- Imported csv files successfully but query results are empty
- common interface for BatchInserter and GraphDatabaseService?
- Why Batch-Importer is not work when i import about one hundred million nodes?
- Improt error,emergency!!!!
- How can i use this tool to import data that may be duplicated HOT 1
- Download link to binary is broken HOT 2
- Failed to load csv in Neo4j Ver 3.3
- An exception occured while executing the Java class. More than one element in org.mapdb.Bind$5$1@46248627. First element is '983727989' and the second element is '997379223' HOT 1
- version 3.4.0
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from batch-import.