inference problem

[Maomaoxion]

Exception in thread Thread-7: Traceback (most recent call last): File "/data/starCoder/software/conda/envs/torch/lib/python3.8/threading.py", line 932, in _bootstrap_inner self.run() File "/data/starCoder/software/conda/envs/torch/lib/python3.8/threading.py", line 870, in run self._target(*self._args, **self._kwargs) File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/generation/utils.py", line 1648, in generate return self.sample( File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/generation/utils.py", line 2730, in sample outputs = self( File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/models/gpt_bigcode/modeling_gpt_bigcode.py", line 808, in forward transformer_outputs = self.transformer( File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/models/gpt_bigcode/modeling_gpt_bigcode.py", line 605, in forward self_attention_mask = self_attention_mask * attention_mask.view(batch_size, 1, -1).to( RuntimeError: The size of tensor a (8192) must match the size of tensor b (8193) at non-singleton dimension 2

When I engage in long conversations, an error occurs halfway through. how to fix it？