Tom Hosking
Tom Hosking
The input is already tokenized: ``` Sentence #301 (13 tokens): Two people outside of a stone building near a red fire hydrant . ```
Amazing, thank you!
Implemented via `lightning.Fabric` in d6a74ab. Could do with tidying up: - ideally use proper Lightning trainers etc - device mapping should be managed within `BaseAgent`. This is a little tricky...
Hi, the [link in the readme](https://github.com/tomhosking/hercules?tab=readme-ov-file#setup) works for me: https://tomho.sk/hercules/data/data_amasum.zip Let me know if you have any further issues downloading it.
Hi, I was just able to download and unzip the files when I tried. Can you give some more detail on the problem that you're experiencing?
Hi, thanks for your interest! The decoder is a standard Transformer decoder that uses cross attention on an input "sequence", like BART or a machine translation model. For Hercules, this...