dpiras / gmm-mi Goto Github PK
View Code? Open in Web Editor NEWEstimation of mutual information (MI) distribution with Gaussian mixture models (GMMs)
License: GNU General Public License v3.0
Estimation of mutual information (MI) distribution with Gaussian mixture models (GMMs)
License: GNU General Public License v3.0
See #2.
So far, GMM-MI can only be applied to unidimensional variables; we want to extend it to the multivariate case. It should not be too much work, since we showed that we can extend to higher dimensionalities with conditional MI.
We need to choose if we can re-use the methods currently implemented to estimate MI between unidimensional variables, or whether it is cleaner to create three separate methods. Once implemented, we plan to test this against e.g. work done in Sui et al. (2023).
To better visualise the fitted model of the joint pdf, especially in higher dimensions when the conditional MI is computed, it would be nice to use something like chainconsumer
to use the original samples and samples from the fitted GMM to obtain contour plots to compare.
As in the title; we only implemented MC integration when estimating categorical-continuous MI.
Also remove reference to loss curves when doing the categorical fit (or check they are indeed stored).
Should be a simple tweak at the end, based on the required base of the logarithm (nats, bits)
When fitting a model, a single metric (validation loss, AIC or BIC) is used to select the number of components. However it might be nice to also store the value of the BIC and AIC (if using validation) so that one does not have to re-fit the model to get the other values of the metrics.
So far, only arrays with shape (n_samples, 2)
can be passed in the continuous case. This can be annoying if I have the samples from the two variables as separate arrays, since one needs to manually stack them. It should be easy to add the possibility of passing either a 2-D array, or two 1-D arrays.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.