OFASys icon indicating copy to clipboard operation
OFASys copied to clipboard

about the running

Open TheOnlylight opened this issue 1 year ago • 1 comments

the trainer cannot do the truncation by default

[/usr/local/lib/python3.9/dist-packages/ofasys/adaptor/general.py](https://rv8u4ubipi-496ff2e9c6d22116-0-colab.googleusercontent.com/outputframe.html?vrz=colab-20230307-060233-RC01_514758488#) in concat(self, modality_outputs)
    275                 end_pos = start_pos + seq_length
    276                 if modality_output.self_attn_bias[idx] is not None:
--> 277                     self_attn_bias[:, :, start_pos:end_pos, start_pos:end_pos] += modality_output.self_attn_bias[idx]
    278                 start_pos = end_pos
    279             assert start_pos == output.seq_length

RuntimeError: The size of tensor a (1025) must match the size of tensor b (1024) at non-singleton dimension 3

TheOnlylight avatar Mar 09 '23 06:03 TheOnlylight

Did you solve it?

lllxf avatar Feb 19 '24 10:02 lllxf