Class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found

[smic-jurigutierrez]

Class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found

[jaumpedro214]

Hello,

First of all, thanks for the words, I'm glad to hear that my posts are helping.

This issue occurs probably because Spark was not properly configured with the Jars to establish a connection with GCS.

To solve, just download the GCS connection jar:
https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-latest-hadoop2.jar

And put it in the folder $SPARK_HOME/jars folder
This needs to be done in the same machine where the Jupyter server + spark client are installed.

My references are this post and the official GCP connector docs.

Hope it helps,

[smic-jurigutierrez]

Hi @jaumpedro214,

Thank you so much, I missed to put the jar on the Jupyter server.
It works perfectly now.

Regards,