mirasol-pytorch icon indicating copy to clipboard operation
mirasol-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains
→

Metadata

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

Results 1 mirasol-pytorch issues
Sort by recently updated
recently updated
newest added

Cross-attention question

Hi, I have another question. It seems that in all cross-attention layers, the context is fixed as the av_embeddings. I am not familiar with the cross-attention mechanism. Is that right?

ZSL98 avatar ZSL98

← Metadata

85
Stars
1
Forks
Watchers

Owner

verified publisher icon lucidrains

Metadata

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

Back