calliope
calliope
Same here
@sfc-gh-truwase ``` deepspeed_config = { "bf16": {"enabled": True}, "zero_optimization": { "stage": 3, "offload_optimizer": {"device": "cpu", "pin_memory": True}, "offload_param": {"device": "cpu", "pin_memory": True}, "stage3_param_persistence_threshold": 1e3, # Set as small as possible...
I was able to install it with `uv add mamba-ssm --no-build-isolation`, but I want to install it only with `uv sync`.
I haven't found a fundamental solution yet, but I found that it works fine when I set the batch size to 16, so I'm using that as a workaround for...
How about 5090,5080?