Comments (3)
Ahhh i was to fast with my decision...
Traceback (most recent call last):
File "/home/jan-k/.local/bin/parquet-tools", line 8, in <module>
sys.exit(main())
File "/home/jan-k/.local/lib/python3.6/site-packages/parquet_tools/cli.py", line 26, in main
args.handler(args)
File "/home/jan-k/.local/lib/python3.6/site-packages/parquet_tools/commands/show.py", line 60, in _cli
with get_datafame_from_objs(pfs, args.head) as df:
File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/home/jan-k/.local/lib/python3.6/site-packages/parquet_tools/commands/utils.py", line 190, in get_datafame_from_objs
df: Optional[pd.DataFrame] = stack.enter_context(pf.get_dataframe())
File "/usr/lib/python3.6/contextlib.py", line 330, in enter_context
result = _cm_type.__enter__(cm)
File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/home/jan-k/.local/lib/python3.6/site-packages/parquet_tools/commands/utils.py", line 71, in get_dataframe
yield pq.read_table(local_path).to_pandas()
File "table.pxi", line 1120, in pyarrow.lib.Table.to_pandas
File "/home/jan-k/.local/lib/python3.6/site-packages/pyarrow/pandas_compat.py", line 612, in table_to_blockmanager
columns = _flatten_single_level_multiindex(columns)
File "/home/jan-k/.local/lib/python3.6/site-packages/pyarrow/pandas_compat.py", line 742, in _flatten_single_level_multiindex
labels, = index.labels
AttributeError: 'MultiIndex' object has no attribute 'labels'
any parquet i queried returned same error, so i created venv with python3.6.9 and now i get following error:
Traceback (most recent call last):
File "/home/jan-k/Code/dev/venv/bin/parquet-tools", line 5, in <module>
from parquet_tools.cli import main
File "/home/jan-k/Code/dev/venv/lib/python3.6/site-packages/parquet_tools/cli.py", line 2, in <module>
from parquet_tools.commands import show, csv, inspect
File "/home/jan-k/Code/dev/venv/lib/python3.6/site-packages/parquet_tools/commands/show.py", line 9, in <module>
from .utils import (FileNotFoundException, InvalidCommandExcpetion,
File "/home/jan-k/Code/dev/venv/lib/python3.6/site-packages/parquet_tools/commands/utils.py", line 4, in <module>
from dataclasses import dataclass
ModuleNotFoundError: No module named 'dataclasses'
ok i installed dataclasses
and it works, closing issue
from parquet-tools.
@jan-kwiatkowski Thank you for making issue.
I couldn't reproduce your problem in my machine.
Please give me some information about
- command you run
- traceback
- parquet file
from parquet-tools.
I tried again with python 3.6 and it worked sorry for inconvenience.
from parquet-tools.
Related Issues (20)
- Windows trouble installing with pip HOT 1
- Including license files HOT 2
- num_rows negative HOT 10
- Use newer arrow
- Head argument is ignored when --columns are specified HOT 1
- Missing `dataclasses` in requirements HOT 2
- File "/usr/lib/python2.7/site-packages/parquet_tools/cli.py", line 5 HOT 1
- Schema command not working HOT 2
- Broken pipe when piping to `less`
- Detection of compression `lz4` not supported
- Show column sizes and metadata for inspect
- Add show meta HOT 1
- Setting to force length of columns (truncate in spark)
- [feature request] support json as conversion format or better csv support
- Update readme to reflect the current implementaion HOT 1
- Invalid concatenation for multiple parquet files with different columns structure
- make --endpoint-url configurable by environment, or move it before the subcommand HOT 1
- incompatible with moto >= 5
- viewing or browsing large files
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from parquet-tools.