zhouyonglong

改成和2.1.3版本一致就可以了，少传入attn_mask这个参数 def infer(self, inputs, attn_mask): **last_hidden_states = self.ls_bert.infer(inputs, _attn_mask_)** last_hidden_states = torch.Tensor(last_hidden_states).float() pooled_output = self.pooler(last_hidden_states.to("cuda:0")) logits = self.classifier(pooled_output) return logits 但是lightseq性能还不huggingface未加速版本，GPU是 1080Ti ====================END warmup==================== tokenizing the sentences... =========lightseq========= lightseq generating......

我也用的是1080ti，cuda11.0，tensorflow2.4，在example里面的bart测试上也不如huggingface版本

https://github.com/zhouyonglong/Fast-Python-Collaborative-Filtering-for-Implicit-Datasets/blob/master/implicit/als.py里面有一个explain函数