Add describe() for LazyFrame

[niccolopetti]

Add describe() for LazyFrame

[alexander-beedie]

Yup, I think it's worthwhile - I can see that there are plenty of cases where you don't want to materialise GBs of data into a local frame just to run describe() on it 🤔

[stinodego]

Fair enough - that seems like a valid use case. I'll re-open to see what others have to say.

[mcrumiller]

"looks pretty lazy!" sounds like an accurate description to me, can we just return that?

[stinodego]

describe is meant as a way to get some quick insights in your data. It could work on a LazyFrame, but then you would have to call collect() right after anyway, otherwise you're not much wiser. It just doesn't make sense as a lazy method.

Just collect first and then use describe.

[niccolopetti]

describe is meant as a way to get some quick insights in your data. It could work on a LazyFrame, but then you would have to call collect() right after anyway, otherwise you're not much wiser. It just doesn't make sense as a lazy method.

Just collect first and then use describe.

But what if the Dataframe is so big that it wouldn't fit in memory?