AWS Glue Jobs with: {"error":"TypeError: 'JavaPackage' object is not callable","errorType":"EXECUTION_FAILURE"}

[maxreis86]

AWS Glue Jobs with: {"error":"TypeError: 'JavaPackage' object is not callable","errorType":"EXECUTION_FAILURE"}

[maxreis86]

Hi dear @krasinski,

I could run successfully following your step!

1. Downloaded sparkling water distribution zip: http://h2o-release.s3.amazonaws.com/sparkling-water/spark-3.1/3.36.1.1-1-3.1/index.html
2. Dependent JARs path: s3://bucket_name/sparkling-water-assembly-scoring_2.12-3.36.1.1-1-3.1-all.jar
3. --additional-python-modules, h2o-pysparkling-3.1==3.36.1.1-1-3.1

Thank you so much for your help!!

[krasinski]

Hello @maxreis86,

Thank you for reporting that. I was able to reproduce and analyse your issue. The reason behind it is a bit complicated classpath problem which will need more time to resolve.

In the meantime I would suggest a workaround:

1. Download the sparkling water distribution zip, exactly the same version you're installing using pip.
2. In the jars folder you will find a jar named (depending on the version) like this: sparkling-water-assembly-scoring_2.12-3.36.0.4-1-3.1-all.jar
3. Upload it to your S3 bucket
4. Add S3 URL to that jar to your Glue job - in the UI it will be Dependent JARs path option
5. Leave the additional-python-modules parameter as is