Yunshui Li

icon company University of Chinese Academy of Sciences icon location Beijing, China icon location NLPer, LLM, Knowledge Graph, Visual-Lauguage Dialog System

Results 1 issues of Yunshui Li

attn_mask

3 comment

```python cls_mask = rearrange(text!=self.pad_id, 'b j -> b 1 j') attn_mask = F.pad(cls_mask, (0, 1, seq, 0), value=True) attn_mask = rearrange(attn_mask, 'b i j -> b 1 i j') sim...