Comments (5)
You can do that with a when -> then -> otherwise
:
foo = pl.col("foo")
pl.when(foo.is_null()).then(foo.mode().first())
And fill_null
also accepts expressions:
foo.fill_null(foo.mode().first())
from polars.
What if there is not a unique mode?
from polars.
This is a good point. https://docs.pola.rs/py-polars/html/reference/series/api/polars.Series.mode.html do mention the possibility of having multiples values. I guess this would involve having a method to tie break them which could be none or random for example. This will then be a feature request for mode.
from polars.
Thanks @ritchie46, I was not mentioning it is not possible. I actually use the fill_null
that you mentioned in your example but I was referring that it could be good to either add this example in the doc or as a strategy
option for the method arguments in https://github.com/pola-rs/polars/blob/py-0.20.30/py-polars/polars/dataframe/frame.py#L7202 as this is pretty helpful for string and the other alternatives ({None, ‘forward’, ‘backward’, ‘min’, ‘max’, ‘mean’, ‘zero’, ‘one’}
) do not help in the case of string.
from polars.
Someone did request this previously #15007 but they closed the issue.
(So it seems like a useful doc example at the very least?)
.mode()
does counts nulls
>>> pl.Series([1, None]).mode()
shape: (2,)
Series: '' [i64]
[
1
null
]
>>> pl.Series([1, None, None]).mode()
shape: (1,)
Series: '' [i64]
[
null
]
I've not seen it mentioned before, so I'm not sure if this is intended or not - but currently you'd need to drop them.
For comparison, pandas drops them by default:
>>> pd.Series([1, None, None]).mode()
0 1.0
from polars.
Related Issues (20)
- `pl.lit(None, dtype=pl.Struct({"a": pl.Int64()}))` gives `{'a': None}`, not `None` HOT 1
- Support equality operation on nested Array types
- Unordered enum data type HOT 4
- Support interval expressions in Python SQL Context
- minimal `dyn int` when reading from python HOT 1
- Panic when casting Array of Categoricals to Array of String HOT 2
- dt.epoch() is much slower than truediv() for the same operations HOT 1
- PanicException when using collect(streaming=True) on two LazyFrames from `scan_parquet()` calls.
- Allow Zero width no-break space in float parser HOT 7
- Alternative method 10x faster than dt.offset_by() HOT 2
- Sampling with groupby HOT 1
- Sample by Group HOT 4
- Add `make test-ci` to (mostly) replicate CI tests HOT 4
- Allow use of ParquetWriter, ParquetReader w/o compiling all compression deps (WASM support) HOT 8
- rename π to selected_columns and σ to filters in logal graph dot? HOT 4
- Add `polars.Expr.list.drop_nans()` HOT 2
- `read_parquet` don't recognize OSS url scheme
- Not clear if Parquet statistics are used when filter applied
- `bottom_k` should not include nulls if the column contains at least `k` valid elements
- Construct CsvReader from bytestream using CsvReadOptions
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from polars.