Comments (1)
I think this is a bug in pytables::_set_tz()
, where the unit is hard-coded as ns. I submitted a PR which will hopefully resolve this issue.
Just for reference, here is a trace stack I used for debugging the reproducible code:
**** This doesn't work
Calling _read_group()
type of Storer: <class 'pandas.io.pytables.FrameFixed'>
Calling BlockManagerFixed.read()
Calling GenericFixed.read_array()
Checking dtype in read_array(): datetime64[s]
Checking value read from node: [[ 978307200]
[1012608000]] # It is correct so far.
Checking value after reconstructing time zone: <DatetimeArray>
[
['1970-01-01 00:00:00.978307200'],
['1970-01-01 00:00:01.012608']
]
Shape: (2, 1), dtype: datetime64[ns] # So the time zone attribution messed it up somehow.
block0_values <DatetimeArray>
[
['1970-01-01 00:00:00.978307200', '1970-01-01 00:00:01.012608']
]
Shape: (1, 2), dtype: datetime64[ns]
columns Index([0], dtype='int64')
###### result: 0
0 1970-01-01 00:00:00.978307200
1 1970-01-01 00:00:01.012608000
**** However this does work
Calling _read_group()
type of Storer: <class 'pandas.io.pytables.FrameFixed'>
Calling BlockManagerFixed.read()
Calling GenericFixed.read_array()
Checking dtype in read_array(): datetime64[ns]
Checking value read from node: [[ 978307200000000000]
[1012608000000000000]]
Checking value after reconstructing time zone: <DatetimeArray>
[
['2001-01-01 00:00:00'],
['2002-02-02 00:00:00']
]
Shape: (2, 1), dtype: datetime64[ns]
block0_values <DatetimeArray>
[
['2001-01-01 00:00:00', '2002-02-02 00:00:00']
]
Shape: (1, 2), dtype: datetime64[ns]
columns Index([0], dtype='int64')
###### result: 0
0 2001-01-01
1 2002-02-02
from pandas.
Related Issues (20)
- BUG: Series.replace(dict-like, dict-like) raises uninformative AttributeError HOT 1
- BUG: escapechar=',' Causes Double Commas in Output in Pandas 2.2.2 HOT 5
- DOC: fix docstring validation errors for `pandas.Timestamp` HOT 20
- DOC: Development on Gitpod have problems HOT 1
- BUG: Ability to set both color and style in pandas plotting HOT 3
- Title: Feature Request: Improve diff Function to Support Forward and Backward CompletionENH: HOT 2
- Title: Feature Request: Improve diff Function to Support Forward and Backward CompletionENH: HOT 2
- Bug in Chunk Processing: Non-NULL IDs Become NULL During IterationBUG: HOT 2
- ENH: Add Float128 support for groupby. HOT 4
- PERF: Excessive memory consumption in pd.read_parquet HOT 3
- BUG: Resampling to `"B"` frequency with `closed="right"` and `label="right"` adds empty bins HOT 4
- BUG: ArrowNotImplementedError: Unsupported cast from int64 to null using function cast_null HOT 3
- ENH: Adding `skipna:bool` to Rolling.sum HOT 2
- BUG: Replace fails after NaN in a Series of `string` HOT 2
- DEPR: future.no_silent_downcasting option HOT 1
- BUILD: Python Docker Build Issues HOT 4
- DOC: Incorrect Documentation: pd.Dataframe.dropna HOT 2
- BUG: Spurious `FutureWarning` when using `pd.read_json()` HOT 4
- BUG: read_json silently ignores the dtype when engine=pyarrow HOT 2
- ENH: support the Arrow PyCapsule Interface on pandas.Series (export) HOT 14
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pandas.