tt-pytorch

tt-pytorch copied to clipboard

I have been trying to use the tensor decomposition on a personal project from your `to_tt_matrix` and `to_tt_tensor`. However, I donot understand what the additional shape parameter in `t3nsor.decompositions.to_tt_matrix()` stand...

Ujjawal-K-Panchal

TT embedding provides good a embedding compression ratio. However, I don't know how to control the compression rate by setting the shapes and TT-rank. My goal is to apply tt_embedding...

xpai

is there a way to initialize the TTEmbedding layer with a pre-trained embedding tensor?

ibulu

tt_conv is not implemented here

1

I have read the paper, it is very interesting work, but I was thinking to use it with Conv layers, but the Conv layer is not implemented. I have researched...

Silk760

High GPU memory consumption

4

Hi, I tried to integrate the TTLayer into transformerXL, however I found that it consumes much more memory than usual. Did you experience such problems? do you know anyway around...

saareliad

There is a problem with .view() during .full() operation with master version of pytorch.

Aelphy

`TTLayer` doesn't work with non-contiguous input matrix

2

Репорчу баг, доставляющий сложности с использованием твоего TTLayer в некоторых моделях (например в Tensor Train GRU). ``` in forward(self, X) 63 # this is also called d^{(t)} 64 updated_hidden_state_value =...

philip-bl