jackwilkie

icon company University of Strathclyde icon location Glasgow

Results 2 issues of jackwilkie

multiblock mask collator now samples masks including last row and column

2 comment

Previously multiblock mask position sampler used the line torch.randint(0, self.height - h, (1,))... , however since randint is exclusive of the upper bound self.height - h, and similarly self.width -...

CLA Signed

Update saint_i.py

Inter sample attention now inherits from nn.MultiheadAttention which includes optimizations such as flash attention