Comments (2)
thanks @Chuck321123 for the report
agree - I think something similar to #16615 and #16666 could be done
will try to work on a pr this week
from polars.
@MarcoGorelli Thanks. Based of this example
%timeit df.with_columns(pl.from_epoch((pl.col("UTC_Time").dt.epoch(time_unit="us") + 5 * 60 * 1_000_000), time_unit="us"))
notice how much slower it suddenly became when I switched to "us" (or anything other than "ns")
3.87 ms ± 142 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)
If we see issue case #16716, we see similar differences where operations done on anything other than nanoseconds, performs much slower. Don't know if this is expected, but if it's not, it might be worth looking into this as well
from polars.
Related Issues (20)
- `sort_by("col", nulls_last=True).over("other")` does not put nulls at the end HOT 2
- Native `delta` reader and writer using delta-kernel-rs
- ComputeError: could not append value when creating Polars DataFrame HOT 4
- `pl.Expr.list.get` returns erroneous results after version `0.20.19` HOT 3
- Implement (de)serialization of Series/DataFrames using IPC
- `pl.Expr.list.get` raises error on null values. HOT 5
- polars.read_delta from a GCP bucket using service account
- `scan_parquet` expects columns to be in the same order iff `POLARS_FORCE_ASYNC=1` or scanning against cloud, local works regardless of ordering HOT 1
- PanicException when doing a `scan_parquet` on files with mismatching schemas HOT 2
- Loading wide parquet data with `scan_parquet` is orders of magnitude slower than long data HOT 1
- `pl.Expr`.sort_by('date').over("code") doesn't sort in fact. HOT 4
- Fix broken links to unpivot (was melt) HOT 2
- Combine `engine_options` and `read_options` into a single parameter in `read_excel` HOT 5
- Deprecate `LazyFrame.fetch`
- Fill_null() does not cast ALL Null values to other dtype(Nested Dataclass) HOT 1
- DataFrame arithmetic PanicException when lengths differ
- `.list.gather` PanicException unreachable code when invalid argument given
- Standardize references to "null" in methods HOT 9
- Migrate to PyO3 0.22 HOT 2
- Panic when streaming unsupported datatypes to CSV
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from polars.