BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

failed to run benchmark for bitnet_b1_58

Open bmerkle opened this issue 4 months ago • 0 comments

I followed the instructions in https://github.com/microsoft/BitNet?tab=readme-ov-file#benchmark

I downloaded bitnet_b1_58-large, however running the benchmark with python utils/generate-dummy-bitnet-model.py models/bitnet_b1_58-large --outfile models/dummy-bitnet-125m.tl1.gguf --outtype tl1 --model-size 125M failed:

(bitnet-cpp) PS C:\work\microsoft\BitNet> python utils/generate-dummy-bitnet-model.py models/bitnet_b1_58-large --outfile models/dummy-bitnet-125m.tl1.gguf --outtype tl1 --model-size 125M Traceback (most recent call last): File "C:\work\microsoft\BitNet\utils\generate-dummy-bitnet-model.py", line 1048, in main() File "C:\work\microsoft\BitNet\utils\generate-dummy-bitnet-model.py", line 971, in main model_class = Model.from_model_architecture(hparams["architectures"][0]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\work\microsoft\BitNet\utils\generate-dummy-bitnet-model.py", line 312, in from_model_architecture raise NotImplementedError(f'Architecture {arch!r} not supported!') from None NotImplementedError: Architecture 'LlamaModel' not supported!

is there a necessary dependency missing / not installed ?

bmerkle avatar Oct 18 '24 23:10 bmerkle