Sensible Default bin size

[juliastats]

Sensible Default bin size

[OmriTreidel]

Yep, I'm already working on it.

[simonbyrne]

Note that the choice of the number of bins here should be different than a histogram.

In a histogram, you choose the number of bins as a method of avoiding overfitting (i.e. regularization).

For a KDE, the number of bins just affects the numerical resolution of the resulting function, so you want to choose as many as your computational budget allows (up to the resolution of your screen, or whatever needs you have). Ideally it should also be a power of 2 to gain the most advantage from the FFTs. The regularization is handled by the kernel function.

The 2048 was admittedly a pretty arbitrary pick, based on scaling up R's choice (512) by a bit.

[OmriTreidel]

Whenever he is talking to his wife/girlfriend ;)

[ararslan]

That seems like a good idea to me. Would you be interested in putting together a PR for this?

[OmriTreidel]

Thank for that comments, I haven't noticed that. This ticket seems rather pointless than. Unless there is another reason to do it?

[ararslan]

We could implement a different a more data-aware default than 2048. Perhaps there's some literature around that recommends something along those lines for kernel density estimation rather than histograms?

[OmriTreidel]

I think Simon is right, it doesn't seem to make any difference for the resulting density other than sampling.

[ararslan]

I think Simon is right

Agreed. After all, when isn't he right? 😄