s4
s4 copied to clipboard
state-spaces
Structured state space sequence models
I understand that models/s4/s4.py is a standalone file that can be taken on its own to use the S4 models, not counting the CUDA kernel module. I have some questions...
After I installed the cauchy-mult extension as indicated in the readme, I noticed I still get the warning `CUDA extension for cauchy multiplication not found. Install by going to extensions/cauchy/...
In SSMKernelDPLR._setup_linear and SSMKernelDPLR._step_state_linear, it is documented that: _"Version of the step function that has time O(N) instead of O(N^2) per step, which takes advantage of the DPLR form and...
Hi team! The paper and the accompanying codebase are really great! We are trying to use S4 for a different problem and there are a lot of engineering details that...
I am building an encoder/decoder architecture where the encoder and decoder are S4 models. Since this is for a generative task I want to use the step function defined in...
I'm working on an application in which, during the training phase, I'd pass a tensor to the S4, and I'd like to start generating a rollout (in a recurrent mode)...
I want to train a S4 model on midi, which I already have as discrete events, for example in the form of .csv. How do I create a dataset with...
Thank you for the wonderful and insightful repo, are there any plans on releasing the code for S4ND layer? Roy
Versions: - Python 3.9.14 - macOS 12.6 - state-spaces@292984c - ludwig@1d8154f Hello! I'd like to add S4 into the [Ludwig OSS project](https://github.com/ludwig-ai/ludwig). I've successfully imported and initialized the S4 module....
my l2 loss did not reduce... /(ㄒoㄒ)/~~
