MikeStone66

Error when trying to load Mistral-Small-3.2-24B-Instruct-2506

3

When trying to load "Mistral-Small-3.2-24B-Instruct-2506" I get the following error. `04:23:50-340552 INFO Loading "mistralai_Mistral-Small-3.2-24B-Instruct-2506" 04:24:10-615718 INFO TRANSFORMERS_PARAMS= { 'low_cpu_mem_usage': True, 'torch_dtype': torch.bfloat16, 'attn_implementation': 'sdpa', 'device_map': 'auto', 'max_memory': {0: '16GiB', 1:...