KnowledgeCircuits
KnowledgeCircuits copied to clipboard
Published
20 hours ago •
zjunlp
zjunlp
[NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
Results
1
KnowledgeCircuits issues
Sort by
recently updated
recently updated
newest added
``` ./RWKU/KnowledgeCircuits-main/KnowledgeCircuits-main/transformer_lens/components.py:625, in AbstractAttention.forward(self, query_input, key_input, value_input, past_kv_cache_entry, additive_attention_mask, attention_mask) 616 result = self.hook_result( 617 bnb.matmul_4bit( 618 z.reshape(z.shape[0], z.shape[1], self.cfg.d_model), (...) 622 ) 623 ) 624 else: --> 625 result...
enhancement