vega/scalable-vega

A demo of scaling Vega to millions of records

Scalable Vega

A demo of how to scale Vega to millions of records. Try it out at https://vega.github.io/scalable-vega/.

The way we implemented this demo is with a custom transform that accepts SQL queries and requests data from a database with the Vega Transform to Query OmniSciDB. You could implement this demo with any other database backend as long as it has an API you can call from your browser. In our demo, we constructed the queries with Vega signals so we can create dynamic queries.

Deployment

We are automatically deploying with GitHub Actions to GitHub Pages whenever there is a commit on master.

scalable-vega's Issues

What's the idea behind the scalability?

I see that the main work that was done to make Vega scalable was to precompute the data (i.e. move calculations into the backend) instead of doing it in transforms. Does this solution help if I need to visualize a large number of data points? (e.g. 500k dots)

Broken demo due to invalid license

1. Open the demo -> nothing shows up
2. Open the developer console

Uncaught (in promise) 
window.TMapDException
error_msg: "License invalid"
__proto__: Error

Demo broken because of failing request/CORS

Both of the demoes seem to have this issue.