OFASys
OFASys copied to clipboard
about the running
the trainer cannot do the truncation by default
[/usr/local/lib/python3.9/dist-packages/ofasys/adaptor/general.py](https://rv8u4ubipi-496ff2e9c6d22116-0-colab.googleusercontent.com/outputframe.html?vrz=colab-20230307-060233-RC01_514758488#) in concat(self, modality_outputs)
275 end_pos = start_pos + seq_length
276 if modality_output.self_attn_bias[idx] is not None:
--> 277 self_attn_bias[:, :, start_pos:end_pos, start_pos:end_pos] += modality_output.self_attn_bias[idx]
278 start_pos = end_pos
279 assert start_pos == output.seq_length
RuntimeError: The size of tensor a (1025) must match the size of tensor b (1024) at non-singleton dimension 3
Did you solve it?