mshumer
Results
1
issues of
mshumer
Getting this error really frequently when querying a Mistral-based model: ValueError: Double free! PhysicalTokenBlock(device=Device.GPU, block_number=9180, ref_count=0) is already freed. Interestingly, it ~primarily~ happens when I'm hitting the endpoint from pure...