BUG: Unable to import `pandas` when `pyarrow` 16.1.0 is installed

[dhirschfeld]

BUG: Unable to import `pandas` when `pyarrow` 16.1.0 is installed

[dhirschfeld]

Corrupted package install, sorry for the noise.

[MatusGasparik]

Thanks @dhirschfeld.
You're right. I use pixi and had to run pixi clean to reinstall the environment and now it seems to work. Strange. Never had such a problem...

[dhirschfeld]

Trying to hack around it leads to a ModuleNotFoundError: No module named 'pyarrow.compute' error.

Perhaps pyarrow needs to be pinned until the errors can be worked around :/

In [11]: pa.__version__ = '16.1.0'

In [12]: import pandas as pd
---------------------------------------------------------------------------
ModuleNotFoundError                       Traceback (most recent call last)
Cell In[12], line 1
----> 1 import pandas as pd

File /opt/python/envs/dev310/lib/python3.10/site-packages/pandas/__init__.py:49
     46 # let init-time option registration happen
     47 import pandas.core.config_init  # pyright: ignore[reportUnusedImport] # noqa: F401
---> 49 from pandas.core.api import (
     50     # dtype
     51     ArrowDtype,
     52     Int8Dtype,
     53     Int16Dtype,
     54     Int32Dtype,
     55     Int64Dtype,
     56     UInt8Dtype,
     57     UInt16Dtype,
     58     UInt32Dtype,
     59     UInt64Dtype,
     60     Float32Dtype,
     61     Float64Dtype,
     62     CategoricalDtype,
     63     PeriodDtype,
     64     IntervalDtype,
     65     DatetimeTZDtype,
     66     StringDtype,
     67     BooleanDtype,
     68     # missing
     69     NA,
     70     isna,
     71     isnull,
     72     notna,
     73     notnull,
     74     # indexes
     75     Index,
     76     CategoricalIndex,
     77     RangeIndex,
     78     MultiIndex,
     79     IntervalIndex,
     80     TimedeltaIndex,
     81     DatetimeIndex,
     82     PeriodIndex,
     83     IndexSlice,
     84     # tseries
     85     NaT,
     86     Period,
     87     period_range,
     88     Timedelta,
     89     timedelta_range,
     90     Timestamp,
     91     date_range,
     92     bdate_range,
     93     Interval,
     94     interval_range,
     95     DateOffset,
     96     # conversion
     97     to_numeric,
     98     to_datetime,
     99     to_timedelta,
    100     # misc
    101     Flags,
    102     Grouper,
    103     factorize,
    104     unique,
    105     value_counts,
    106     NamedAgg,
    107     array,
    108     Categorical,
    109     set_eng_float_format,
    110     Series,
    111     DataFrame,
    112 )
    114 from pandas.core.dtypes.dtypes import SparseDtype
    116 from pandas.tseries.api import infer_freq

File /opt/python/envs/dev310/lib/python3.10/site-packages/pandas/core/api.py:28
     16 from pandas.core.dtypes.missing import (
     17     isna,
     18     isnull,
     19     notna,
     20     notnull,
     21 )
     23 from pandas.core.algorithms import (
     24     factorize,
     25     unique,
     26     value_counts,
     27 )
---> 28 from pandas.core.arrays import Categorical
     29 from pandas.core.arrays.boolean import BooleanDtype
     30 from pandas.core.arrays.floating import (
     31     Float32Dtype,
     32     Float64Dtype,
     33 )

File /opt/python/envs/dev310/lib/python3.10/site-packages/pandas/core/arrays/__init__.py:1
----> 1 from pandas.core.arrays.arrow import ArrowExtensionArray
      2 from pandas.core.arrays.base import (
      3     ExtensionArray,
      4     ExtensionOpsMixin,
      5     ExtensionScalarOpsMixin,
      6 )
      7 from pandas.core.arrays.boolean import BooleanArray

File /opt/python/envs/dev310/lib/python3.10/site-packages/pandas/core/arrays/arrow/__init__.py:1
----> 1 from pandas.core.arrays.arrow.accessors import (
      2     ListAccessor,
      3     StructAccessor,
      4 )
      5 from pandas.core.arrays.arrow.array import ArrowExtensionArray
      7 __all__ = ["ArrowExtensionArray", "StructAccessor", "ListAccessor"]

File /opt/python/envs/dev310/lib/python3.10/site-packages/pandas/core/arrays/arrow/accessors.py:23
     21 if not pa_version_under10p1:
     22     import pyarrow as pa
---> 23     import pyarrow.compute as pc
     25     from pandas.core.dtypes.dtypes import ArrowDtype
     27 if TYPE_CHECKING:

ModuleNotFoundError: No module named 'pyarrow.compute'

[MatusGasparik]

Corrupted package install, sorry for the noise.

What do you mean? I get the same error with pyattow 17.0.0:

AttributeError: module 'pyarrow' has no attribute '__version__'

[dhirschfeld]

I get the same error with pyattow 17.0.0:

Maybe you also have a corrupted package install?

I "fixed" it by uninstalling the package, rm -rf the folder in site-packages. Deleting it also from my package cache and reinstalling.