apache/datafusion-ballista-python

Apache Arrow Ballista Python bindings

Ballista Python Bindings (PyBallista

PyBallista is now located within the main Ballista repo here.

The original README is here.

datafusion-ballista-python's Issues

Github repo link points to non-existent URL

Describe the bug
Project link on the Github repo overview page broken

To Reproduce

1. Visit https://github.com/apache/arrow-ballista-python
2. Click on link
3. Result is 404

Expected behavior
Replace link with https://arrow.apache.org/ballista/user-guide/python.html

Publish to PyPI?

It seems that the package named ballista in the PyPI is not the one from this project?

https://pypi.org/project/ballista/

Use correct attribution in footer of documentation pages

Is your feature request related to a problem or challenge?

To be inline with ASF policy, we should update the text in the footer used in the docs to match the footer used in the main website (https://arrow.apache.org/). i.e. add the trademark attribution test.

I am not sure where the docs are hosted

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

module 'ballista' has no attribute 'BallistaContext'

Describe the bug
I am trying to connect to ballista cluster, but documentation or something must be wrong.

https://arrow.apache.org/ballista/user-guide/python.html

To Reproduce
Steps to reproduce the behavior:
$ pip3 install ballista
$ python3

import ballista
ctx = ballista.BallistaContext("localhost", 50050)
Traceback (most recent call last):
File "", line 1, in
AttributeError: module 'ballista' has no attribute 'BallistaContext'

CI is red

Describe the bug
A clear and concise description of what the bug is.
CI is currently red.

To Reproduce
Steps to reproduce the behavior:

Expected behavior
A clear and concise description of what you expected to happen.

Additional context
Add any other context about the problem here.

Python 3.11.2: pip install -r requirements-310.txt fails

Describe the bug
os: macOS 13.3
python: v3.11.2 (venv)

python -m pip install -r requirements-310.txt

Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
      -- Build Type: RELEASE
      -- Generator: Unix Makefiles
      -- Build output directory: /private/var/folders/cp/ckllsv255631cqswdnxgb5ch0000gn/T/pip-install-c9_6i9ae/pyarrow_1d986c71873643a0a659c11814f85083/build/temp.macosx-13-x86_64-cpython-311/release
      -- Found Python3: /Users/r4ntix/Workspace/github/arrow-ballista-python/venv/bin/python (found version "3.11.2") found components: Interpreter Development.Module NumPy
      -- Found Python3Alt: /Users/r4ntix/Workspace/github/arrow-ballista-python/venv/bin/python
      -- Found PkgConfig: /usr/local/bin/pkg-config (found version "0.29.2")
      -- Could NOT find Arrow (missing: Arrow_DIR)
      -- Checking for module 'arrow'
      --   No package 'arrow' found
      CMake Error at /usr/local/Cellar/cmake/3.26.2/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
        Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR
        ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
      Call Stack (most recent call first):
        /usr/local/Cellar/cmake/3.26.2/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
        cmake_modules/FindArrow.cmake:450 (find_package_handle_standard_args)
        cmake_modules/FindArrowPython.cmake:46 (find_package)
        CMakeLists.txt:231 (find_package)


      -- Configuring incomplete, errors occurred!
      error: command '/usr/local/bin/cmake' failed with exit code 1
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyarrow
Successfully built numpy
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects

To Reproduce
👆

Expected behavior

Additional context

remove notification to the arrow dev mail list

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and why for this feature, in addition to the what)

each action in this repo will trigger a mail to the arrow dev mail list, can we remove this action?
@andygrove

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.