s4
s4 copied to clipboard
state-spaces
Structured state space sequence models
in this .md file, it is shown that, to run the latest LRA results, the commands are: ``` python -m train experiment=lra/s4-lra-listops python -m train experiment=lra/s4-lra-imdb python -m train experiment=lra/s4-lra-cifar...
Hello everyone, I was trying to replicate the results from the paper of Table 13 and 14. Therefore I used the configurations of configs/experiment/forecasting/s4-informer-etth.yaml and adjusted the prediction window inside...
Hi Albert, I came across something in the S4Block class that I'd like to understand better. You mentioned in the forward function that state: (H N) is never needed unless...
When trying to load listops tsv files, the code freezes and doesn't finish executing. same issue as #28. Thanks in advance!
added a sample verification code snippet.
Hi, I'm using the sashimi model on my own dataset with reasonable success for a while now and I wanted to see if I could use the recently released `torch.compile`...
Hi, I'm implementing a decoder for audio generation (DDSP-style) using standalone S4 (V3). I'd like to save checkpoints during the training and eventually the final model. When training the model...
``` [2023-03-30 02:45:03,037][__main__][INFO] - Instantiating callback Error executing job with overrides: [] Traceback (most recent call last): File "/home/rupax/github/state-spaces/train.py", line 553, in main train(config) File "/home/rupax/github/state-spaces/train.py", line 496, in train...
I've noticed that the translated Laguerre (LagT) HiPPO fails to properly approximate signals in [`hippo_function_approximation.ipynb`](https://github.com/HazyResearch/state-spaces/blob/main/notebooks/hippo_function_approximation.ipynb) (see picture below). The generalized Laguerre formulation in [`hippo.py`](https://github.com/HazyResearch/state-spaces/blob/02e1ba8731ceea90db8343d6e9e150509607bec7/src/models/hippo/hippo.py#L43-L51) also fails. Any clue as to...
I attempted to execute the code while enabling bf16 but came across some error messages. Furthermore, I conducted a search for the keywords "bf16" or "fp16" within this repository but...
