cohenjer/tensorly-gcp

TensorLy-Gcp

TensorLy-Gcp is a Python library for generalized parafac decomposition (GCP) [1] and its stochastic version (SGCP) [2] which allow using different kind of losses rather than only Euclidean that builds on top of TensorLy. Both algorithms aim at decreasing loss between the input tensor and estimated tensor by using gradient which is calculated according to the selected loss by the user.

While GCP implementation uses Limited-memory BFGS (LBFGS) method for optimization, SGCP uses ADAM optimization as in [2]. Following losses can be used in Tensorly-Gcp:

• Rayleigh
• Bernoulli odds
• Bernoulli logit
• Gamma
• Poisson count
• Poisson log
• Gaussian

Contributing

At the moment, only Numpy backend is supported to implement GCP and SGCP. This library can be compatible with other backends (Pytorch, Tensorflow, Jax, Mxnet) by improving LBFGS with the given information in here. Then, this library can be merged in TensorLy.

Usage

It is possible select one of the losses from the list above according to your data distribution and you can apply generalized decomposition easily:

from tlgcp import generalized_parafac
rank = 3
loss = 'rayleigh'
tensorgcp, errorsgcp = generalized_parafac(tensor, rank=rank, loss=loss)

Installing TensorLy-GCP

Through pip

pip install tensorly-gcp   

From source

git clone https://github.com/tensorly/gcp
cd gcp
pip install -e .

References