Add data examples and create tables

[skatteetaten]

Add data examples and create tables

[zhenik]

Update 1

CSV support blocker Skatteetaten/terraform-nomad-hive#12

References: https://towardsdatascience.com/load-and-query-csv-file-in-s3-with-presto-b0d50bc773c9

Presto’s CSV format support requires metastore.storage.schema.reader.impl=org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader in the metastore-site.xml Hive Metastore configuration file.

How to resolve [RESOLVED]

• fix blocker #13
• add additional env var to hive, when deploy

hive_container_environment_variables =[ 
 "HIVE_SITE_CONF_metastore_storage_schema_reader_impl=org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader"
]

[zhenik]

Update 2

presto-cli require java.
Blocker on vagrant-hashistack #304

Log

vagrant@vagrant:/vagrant/dev/ansible$ ../../presto_340 --server localhost:8080 --catalog hive --schema default --user presto --file ../../example/resources/query/csv_create_table.sql
../../presto_340: 3: exec: java: not found
vagrant@vagrant:/vagrant/dev/ansible$ which java
vagrant@vagrant:/vagrant/dev/ansible$ echo $JAVA_HOME

vagrant@vagrant:/vagrant/dev/ansible$ 

How to resolve option 1

• fix java installation on base image (vagrant-bionic64-ansible-docker #3)(fredrikhgrelland/vagrant-bionic64-ansible-docker#3)
• new release vagrant-bionic64-ansible-docker
• new release vagrant-hashistack based on vagrant-bionic64-ansible-docker

How to resolve option 2

• Build docker image with java and presto-cli. Use --network host mode with docker container