CoLT5-attention icon indicating copy to clipboard operation
CoLT5-attention copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains
→

Metadata

Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch

Results 3 CoLT5-attention issues
Sort by recently updated
recently updated
newest added

Simple ViT error

1 comment

Hello, I'm trying to apply this to cv, using the code from Simple Vit give me this error. ![image](https://github.com/lucidrains/CoLT5-attention/assets/45538477/c800cfbb-5051-497e-a75d-0a22e2b33eb6) There seems to be an error in this code ![image](https://github.com/lucidrains/CoLT5-attention/assets/45538477/173e3c9d-802a-4bd1-b17e-d3d62cd3bb9b)

matrix0117 avatar matrix0117

Could u plz provide more details about the training info, thx a lot!

what hardware are used? how long does the training take? thx

bopeng87 avatar bopeng87

update autocast

Update autocast function from deprecated argument to the new one.

Abdelrahman350 avatar Abdelrahman350

← Metadata

218
Stars
12
Forks
Watchers

Owner

verified publisher icon lucidrains

Metadata

Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch

Back