pytorch-tensor-decompositions
pytorch-tensor-decompositions copied to clipboard
PyTorch implementation of [1412.6553] and [1511.06530] tensor decomposition methods for convolutional layers.
```bash Traceback (most recent call last): File "main.py", line 112, in tl.set_backend('pytorch') File "/opt/conda/lib/python3.8/site-packages/tensorly/backend/__init__.py", line 213, in set_backend backend = cls.load_backend(backend) File "/opt/conda/lib/python3.8/site-packages/tensorly/backend/__init__.py", line 191, in load_backend importlib.import_module('tensorly.backend.{0}_backend'.format(backend_name)) File "/opt/conda/lib/python3.8/importlib/__init__.py",...
Hi Jacob Gildenblat, Thank you for your repo! I think your work is beautiful! Now, I encounter a problem with the code. When I run the EVBMF function, the output...
Hi, thanks for the great implementation of tensor decomposition. However, when I apply your code to my resnet model, the decomposed model actually has more parameters than the original one....
I'm getting the following error when trying to run tucker decomposition: ValueError Traceback (most recent call last) [](https://w6i4tsigmep-496ff2e9c6d22116-0-colab.googleusercontent.com/outputframe.html?vrz=colab-20230720-060118-RC00_549558378#) in () 1 print('* Before the decomposition:') 2 print(layer) ----> 3 layer_tucker_decomposed...
I use pytorch 1.10 and tensorly 0.4.0.,but I got error as following: File "/content/drive/MyDrive/Tensor_decomposing/decompositions.py", line 14, in cp_decomposition_conv_layer parafac(layer.weight.data, rank=rank, init='svd') File "/usr/local/lib/python3.9/dist-packages/tensorly/decomposition/candecomp_parafac.py", line 153, in parafac factor = T.transpose(T.solve(T.transpose(pseudo_inverse),...
I want to implement your code (CP) in keras. since you replace each convolution layer with four convolution layers in sequence, I am ok with the first and last layers,...
Great job! If I want to implement TT and TR to decompose the convolution layer, what should I do?