Giter Site home page Giter Site logo

foursquare / h3-presto Goto Github PK

View Code? Open in Web Editor NEW
7.0 38.0 2.0 275 KB

Presto bindings for H3, a hierarchical hexagonal geospatial indexing system

License: Apache License 2.0

Java 98.86% Dockerfile 1.14%
foursquare h3 hexagon presto spatial-indexing

h3-presto's Issues

Unable to use h3-presto plugin

When I am trying to deploy prestodb using k8s then the coordinator and worker pods come up and I do see that the H3Plugin is getting loaded successfully.

2024-03-19T23:38:15.129Z        INFO    main    com.facebook.airlift.bootstrap.LifeCycleManager Life cycle startup complete. System ready.
2024-03-19T23:38:15.129Z        INFO    main    com.facebook.presto.server.PluginManager        -- Loading plugin /var/presto/data/plugin/H3Plugin --
2024-03-19T23:38:15.131Z        WARN    main    com.facebook.presto.server.PluginManager        No service providers of type com.facebook.presto.spi.Plugin
2024-03-19T23:38:15.131Z        INFO    main    com.facebook.presto.server.PluginManager        -- Finished loading plugin /var/presto/data/plugin/H3Plugin --
2024-03-19T23:38:15.131Z        INFO    main    com.facebook.presto.server.PluginManager        -- Loading plugin /var/presto/data/plugin/accumulo --
2024-03-19T23:38:15.318Z        INFO    main    com.facebook.presto.server.PluginManager        Installing com.facebook.presto.accumulo.AccumuloPlugin
2024-03-19T23:38:15.347Z        INFO    main    com.facebook.presto.server.PluginManager        Registering connector accumulo
2024-03-19T23:38:15.348Z        INFO    main    com.facebook.presto.server.PluginManager        -- Finished loading plugin /var/presto/data/plugin/accumulo --
2024-03-19T23:38:15.348Z        INFO    main    com.facebook.presto.server.PluginManager        -- Loading plugin /var/presto/data/plugin/atop --
2024-03-19T23:38:15.421Z        INFO    main    com.facebook.presto.server.PluginManager        Installing com.facebook.presto.atop.AtopPlugin

From the prestodb source code (https://github.com/prestodb/presto/blob/7543c0a1cfcbe2e4243403222546bcdc2cb7ff27/presto-main/src/main/java/com/facebook/presto/server/PluginManager.java#L211) It seems like this is the expected behavior.

I followed the build instructions documented in the README of this repo and build the shadow jar and then created a directory called H3Plugin and put the jar there.( I have also tried to name this dir as h3 with the same result BTW)

After this when I connect to my presto server using presto-cli and run the following queries I see the following

presto> SELECT h3_latlng_to_cell(20.0, 10.0, 9) as hex;
Query 20240320_013614_00002_kwne7 failed: line 1:8: Function h3_latlng_to_cell not registered
SELECT h3_latlng_to_cell(20.0, 10.0, 9) as hex

show functions like '%h3%';
 Function | Return Type | Argument Types | Function Type | Deterministic | Description | Variable Arity | Built In | Temporary | Language 
----------+-------------+----------------+---------------+---------------+-------------+----------------+----------+-----------+----------
(0 rows)

Query 20240319_235945_00003_kwne7, FINISHED, 1 node
Splits: 67 total, 67 done (100.00%)
[Latency: client-side: 0:02, server-side: 0:01] [0 rows, 0B] [0 rows/s, 0B/s]

presto> show functions like '%H3%';
 Function | Return Type | Argument Types | Function Type | Deterministic | Description | Variable Arity | Built In | Temporary | Language 
----------+-------------+----------------+---------------+---------------+-------------+----------------+----------+-----------+----------
(0 rows)

Please let me know where I am going wrong with this. A prompt response will be much appreciated.

@isaacbrodsky
@nrabinowitz

Adaptation for Trino

Hello,
One of my devs wants to use the H3 geo and seeing your project I would like them to do the computations and aggregations directly on Trino
I am no Java developer and have no clue about Maven. What would need to be done to be able to use it with Trino, I saw trino uses the same folder structure for plugins so will it be enough to move the Jar on that place? And where can i find the Jar or is this something that i need to build by myself

Thank you

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.