Using BigQuery connector in HDInsights cluster: Guava version conflict

[googleclouddataproc]

Using BigQuery connector in HDInsights cluster: Guava version conflict

[pmkc]

We distribute all of our libraries with a shaded classifier. Were you using that version?

[juliankeppel]

I solved the problem by simply use the maven shade plugin the right way... I had a wrong XML format. Maven doesn't complain about that, but I read the shade plugin documentation again and noticed how to use it the right way.

Something like this works fine:

<plugin>
    <groupId>org.apache.maven.plugins</groupId>
    <artifactId>maven-shade-plugin</artifactId>
    <version>3.1.0</version>
    <configuration>
        <finalName>some-name</finalName>
        <outputDirectory>some-path</outputDirectory>
        <relocations>
            <relocation>
                <pattern>com.google.common</pattern>
                <shadedPattern>com.shaded.google.common</shadedPattern>
            </relocation>
        </relocations>
        <transformers>
            <transformer implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer">
                <mainClass>your.package.structure.ClassName</mainClass>
            </transformer>
        </transformers>
    </configuration>
    <executions>
        <execution>
            <phase>package</phase>
            <goals>
                <goal>shade</goal>
            </goals>
        </execution>
    </executions>
</plugin>

But as little hint: Without shading it doesn't work for me. I really had to shade the com.google.common package.