pyspark_hnsw with pyspark 3.0

[jelmerk]

pyspark_hnsw with pyspark 3.0

[jelmerk]

I haven't actually tried using it with spark 3 yet just 2.3.x and 2.4.x

I'll see if I can find some time to take a look but it will either be a simple fix or a huge headache

[jelmerk]

I released a new version, could you try with

--packages 'com.github.jelmerk:hnswlib-spark_3.0_2.12:0.0.49'

[monkey0head]

Thank your for a quick reply and for new release!

I tried it, but unfortunately was not able to start session with new package.
As I understood it is because parent parent package com.github.jelmerk#hnswlib-parent-pom;0.0.49 is missed on maven.

Traceback is below:

	io problem while parsing ivy file: https://repo1.maven.org/maven2/com/github/jelmerk/hnswlib-spark_3.0_2.12/0.0.49/hnswlib-spark_3.0_2.12-0.0.49.pom (java.io.IOException: Impossible to load parent for file:/home/volodkevich/.ivy2/cache/com.github.jelmerk/hnswlib-spark_3.0_2.12/ivy-0.0.49.xml.original. Parent=com.github.jelmerk#hnswlib-parent-pom;0.0.49)

		module not found: com.github.jelmerk#hnswlib-spark_3.0_2.12;0.0.49

	==== local-m2-cache: tried

	  file:/home/volodkevich/.m2/repository/com/github/jelmerk/hnswlib-parent-pom/0.0.49/hnswlib-parent-pom-0.0.49.pom

	  -- artifact com.github.jelmerk#hnswlib-parent-pom;0.0.49!hnswlib-parent-pom.jar:

	  file:/home/volodkevich/.m2/repository/com/github/jelmerk/hnswlib-parent-pom/0.0.49/hnswlib-parent-pom-0.0.49.jar

	==== local-ivy-cache: tried

	  /home/volodkevich/.ivy2/local/com.github.jelmerk/hnswlib-parent-pom/0.0.49/ivys/ivy.xml

	  -- artifact com.github.jelmerk#hnswlib-parent-pom;0.0.49!hnswlib-parent-pom.jar:

	  /home/volodkevich/.ivy2/local/com.github.jelmerk/hnswlib-parent-pom/0.0.49/jars/hnswlib-parent-pom.jar

	==== central: tried

	  https://repo1.maven.org/maven2/com/github/jelmerk/hnswlib-parent-pom/0.0.49/hnswlib-parent-pom-0.0.49.pom

	  -- artifact com.github.jelmerk#hnswlib-parent-pom;0.0.49!hnswlib-parent-pom.jar:

	  https://repo1.maven.org/maven2/com/github/jelmerk/hnswlib-parent-pom/0.0.49/hnswlib-parent-pom-0.0.49.jar

	==== spark-packages: tried

	  https://dl.bintray.com/spark-packages/maven/com/github/jelmerk/hnswlib-spark_3.0_2.12/0.0.49/hnswlib-spark_3.0_2.12-0.0.49.pom

	  -- artifact com.github.jelmerk#hnswlib-spark_3.0_2.12;0.0.49!hnswlib-spark_3.0_2.12.jar:

	  https://dl.bintray.com/spark-packages/maven/com/github/jelmerk/hnswlib-spark_3.0_2.12/0.0.49/hnswlib-spark_3.0_2.12-0.0.49.jar

		::::::::::::::::::::::::::::::::::::::::::::::

		::          UNRESOLVED DEPENDENCIES         ::

		::::::::::::::::::::::::::::::::::::::::::::::

		:: com.github.jelmerk#hnswlib-spark_3.0_2.12;0.0.49: not found

		::::::::::::::::::::::::::::::::::::::::::::::

[jelmerk]

My bad, could you try again ?

[monkey0head]

Works now! Thanks a lot