Comments (4)
xref #32265. See also #58988 and the comment chain https://github.com/pandas-dev/pandas/pull/58988/files#r1636855759
I wouldnt consider float64, Float64 and double[pyarrow] as the same dtype but different backends in the current state of pandas (there is a separate PDEP out there that talks about creating unified pandas dtypes)
from pandas.
Yes technically even going back to IEEE 757 0/0 is NaN; the Float64 data type does not consider NaN to be a missing value (i.e. NA)
What you expect is reasonable given the history of pandas, but the future of it is uncertain. @asishm has linked the proper discussion; I think in the long term the behavior of the OP is correct but we are just missing a isnan
method if you truly cared to detect NaN
from pandas.
Thank you for the discussion links. Some way to detect the nan beyond np.isnan(df)
would certainly cover our use case. The discrepancy between series.isna()
and series.apply(pd.isna)
is also quite confusing.
from pandas.
thanks for the report!
this looks like the topic of conversation in #32265, so I'm going to close in favour of that
from pandas.
Related Issues (20)
- BUG: Error on to_datetime() after running multiple times in jupyter notebook HOT 1
- PERF: Difference in using zipped pickle files HOT 3
- BUG: Error on query function when the column name has # symbol HOT 1
- BUG: Couldn't run sql: 'Connection' object has no attribute 'cursor' HOT 3
- Surprising behavior: set_index cannot set a MultiIndex from a tuple, only a list HOT 4
- BUG: pandas.to_datetime reports incorrect index when failing. HOT 7
- BUG: Error message in read_csv misleading when using decimal="," HOT 1
- DOC: Add Bodo to out-of-core projects in ecosystem HOT 4
- QST: Is this expected behavior when pd.read_csv() with na_values arguments? HOT 8
- BUG: GroupBy.value_counts doesn't preserve original order for non-grouping rows HOT 2
- pandas.Series.groupby example is not relevant HOT 6
- PERF: Significant Performance Difference in DataFrame.to_csv() with and without Index Reset HOT 2
- BUG: df.to_json causes low precision in floats
- DOC: Typo in docs for na_values parameter in pandas.read_csv function HOT 1
- BUILD: Pandas never succeeds, the most time consuming part of using pandas HOT 2
- ENH: extent Styler `to_latex` for index name styling
- String dtype: overview of breaking behaviour changes HOT 2
- BUG: pandas.read_parquet () dtype_backend argument does not get the default value as documented HOT 4
- BUG: pd.Series.duplicated(keep='first'|'last') returns multiple duplicates HOT 2
- DOC: Website opens search when I press Caps Lock HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pandas.