Parallel?

Open kecaj opened this issue 7 months ago • 1 comments

After the step

python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s1

I see by htop and Activity Monitor that the CPU cores are barely busy.

How can I start a build to use all CPU cores?

May 13 '25 03:05 kecaj

You can try https://github.com/microsoft/BitNet/pull/223/files to see if it works.

May 13 '25 08:05 sd983527