levhaikin

attention weights should be reordered as well as the outputs in case inputs were sorted and packed when doing batch inference

1

https://github.com/huggingface/torchMoji/blob/198f7d4e0711a7d3cd01968812af0121c54477f8/torchmoji/model_def.py#L243 during inference in batches, if `reorder_output` becomes `True` (if `input_seqs` are not of `PackedSequence`), then outputs are correctly reordered to match input order. **however**, if `return_attention` is requested (set...