hive external table of OCI object storage , run select count(*) return error : No FileSystem for scheme "oci"

[oracle]

hive external table of OCI object storage , run select count(*) return error : No FileSystem for scheme "oci"

[jodoglevy]

@zhengwanbo thanks for filing this issue - we'll take a look and get back to you

[omkar07]

hi @zhengwanbo, It seems you are not able to run count query but it has nothing to do with hdfs connector. You will need to do the following:

1. Reference the JAR file before starting the Spark shell i.e by placing hdfs connector lib and third-party jars in spark-3.1.2-bin-hadoop3.2/jars
2. Create .oci folder and copy your api keys. Also, create core-site.xml and place it spark-3.1.2-bin-hadoop3.2/conf folder along with spark-defaults.conf file. follow: https://docs.oracle.com/en-us/iaas/Content/API/SDKDocs/hdfsconnectorspark.htm
3. Run command set hive.compute.query.using.stats=false; on Beeline-Hive. This way, Hive would perform count on the basis of data present in HDFS through a MapReduce job.

I was able to setup and run the count query by following above steps. Below is screenshot. Please let me know if you any questions.

[jodoglevy]

@zhengwanbo - checking in here since we haven't heard back from you in a while. Did @omkar07's response resolve your issue?

[omkar07]

Hi @zhengwanbo - since we haven't heard back from you, we're resolving this issue. But feel free to reopen this if you are still experiencing problems.