hydrolix/spark-connector

Search Hydrolix archives using Databricks

spark-connector's Issues

Caffeine version conflict with Databricks Spark runtime

The Databricks Spark runtime (at least in DBR 13 and 13.1) doesn't shade their dependencies, so when you use the non-shaded version of the connector, you get a version conflict between their version of Caffeine and ours.

It's Considered Harmful to publish assembly jars, but it's annoying to force customers to download and upload a JAR themselves instead of just plugging in the Maven coordinates for the connector.

HDX-4131: Get rid of org_id config parameter

Nearly all users will only be able to authenticate to a single organization; we should get the ID from the login response and use that everywhere. If DB name collisions ever become a problem we can add it back as an optional parameter or namespace component.

apt-build should be apt-get in Dockerfile

In the Dockerfile provided, apt-build should be apt-get