Comments (4)
This is the exact semantics I want!
Except may I recommend the signature of list() be
Def list(vals: Iterable, *, dtype=None)
this would match the API of pythons list(), it would allow for idempotency, and the dtype allows you to pass in a 0 length array and still know the type.
We are solving this exact same thing in ibis-project/ibis#9473
from polars.
This was discussed in the linked issue. I don't believe adding a separate list
function adds much, besides some additional input validation. I'll close this as not planned for now.
from polars.
@stinodego how would one collect a list of pl.List(...)
columns into an outer list? As in take:
df = pl.DataFrame({
"a": [[1, 2, 3]],
"b": [[4, 5, 6]],
})
concatenating the columns into a list:
shape: (1, 1)
┌────────────────────────┐
│ literal │
│ --- │
│ list[list[i64]] │
╞════════════════════════╡
│ [[1, 2, 3], [4, 5, 6]] │
└────────────────────────┘
AFAIK there's no way to do this, because concat_list
is designed to flatten lists, and there is no general method for converting columns into list elements.
from polars.
See my comment in the linked issue, it describes exactly what @mcrumiller talks about, we would need to add special-casing code to ibis in order to be able to support this.
from polars.
Related Issues (20)
- Calling `to_deserializer` with `filter = None` results in a panic HOT 1
- Series is not an instance of Sequence HOT 5
- DataFrame rendering broken on Android HOT 2
- Predicates with `&` where one side is `is_in(Series)` are no longer pushed down to pyarrow scan HOT 1
- Do not cast to supertypes for `is_between` HOT 1
- Unable to read empty dataframe from Parquet without dictionary
- Throw Exception Reading > UInt32 Row Datasets
- Add DRY equivalent for Series HOT 8
- Unexpected results occur when using the head(1) expression in the select method.
- Add cumulative n_unique HOT 1
- Series constructor with NumPy datetime64 scalar returns incorrect results
- Request for new method argmax_horizontal HOT 4
- `pl.struct` inside `list.eval` produces different dtype if fields are named
- Add `Expr.scatter` HOT 3
- Example code for `group_by` iteration is wrong HOT 1
- `unpivot()` on an empty DataFrame creates two empty `variable` columns
- SQL expression panics on invalid query HOT 2
- Make series raw display output to not use single quotes to be consistent with the DataFrame raw display outputs. HOT 9
- ParquetWriter<CloudWriter> hangs when uploading to S3
- When using `.implode().list` in `GroupBy.agg`, the return type is list, not the original type of the value. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from polars.