tsdubose/torgojs

torgojs's Issues

Better clean input data

Right now, I'm getting garbage like asterisks from section breaks. Need to add a stage where things like that get cleaned out.

Rewrite write() to use multiple processes.

Best bet is probably node worker farm

Before it's returned from the API, the parsed work object needs to be checked and cleaned.

For example, you need to look and see whether there are empty objects on it that might screw things up in the long term.

All modules in write() have serious type checking/error issues.

Need to work out let/var use.

I need to standardize use of let and var, probably transition most of my non-for loop lets to var, since I'm not really concerned about block scoping in most places.

figure out mid-paragraph dialogue

There's dialogue in the middle of paragraphs that needs to be handled differently than the text around it.

add epub support

Needs to accept both plain text and ebook input for parsing.

Build/bundle system

Need to work out the build and bundle system for the project.

buildsentence.js needs to handle capitalization and terminal punctuation as well as quotation marks.

Standardize comment formatting

Comments right now are in all kinds of formats. This should be standardized.

First-person personal pronoun handling when sorting characters and themes

Right now, the character and themes module assumes a third-person text every time. This needs to be handled.

Chapter parser is outdated

The data structures have changed significantly, and the chapter parser is now putting out data that is incompatible with the rest of the project.

The chapter parser should only count total number of chapter in a work and then the number of paragraphs per chapter. Note that, as of this writing, the arrayCounter module is only used in the chapter parse module and can almost certainly be moved in there rather than sitting as an independent module.

Standardize data objects

Once the parsing modules are written, the data objects need to be better standardized.

Right now, they are generally of the same form, but some of them have totals and some of them don't. Doing this before trying to combine all of them is obviously important.

Parser test coverage

Need to write tests using Mocha and chai/as promised for all the parser functions.

The dictionary creator needs to take lower-case vs upper case into account

Sentences are not coming out the correct length.

Need to remove all periods when parsing sentences.