Use web workers to process sqlite files

[marbl]

Use web workers to process sqlite files

[fedarko]

https://github.com/kripken/sql.js/blob/master/js/worker.sql.js -- using web workers with sql.js is definitely possible. try this tomorrow. There's some documentation on this in the sql.js readme.

[fedarko]

Diagram of this from a meeting last fall

[fedarko]

Test data, part 1:
-Rendering component 1 of shakya.db with current, no-web-workers version of sql.js: 34 sec from "draw component" to the component being shown

[fedarko]

Alright, so it looks like using the web workers version of sql.js will require some planning to implement. Basically, we'll need to create a separate JS file for the various SQL queries that runs all of the queries and uses postmessage to post the messages of those queries' results, and we'll need to add code in xdot2cy.js that creates a web worker from the new file (e.g. something like var webWorker = new Worker("query_worker.js")) and uses that worker's onmessage parameter to record values and call renderNodeObject, renderEdgeObject, or renderClusterObject accordingly.

For reference, see the README of sql.js, https://github.com/kripken/sql.js/blob/master/test/test_worker.js, and this thread.

[fedarko]

Closing this since we're no longer using sqlite files (we just pass the data straight to the JS now).