Sourav Mishra
Sourav Mishra
I was getting a similar error while executing the inference with bitsandbytes code. I am attaching a portion of it here - ```` File "/home/io452/.cache/huggingface/modules/transformers_modules/microsoft/Magma-8B/ee95aa930708b9991562153ec419b64a25e33024/modeling_magma.py", line 674, in forward inputs_embeds,...
Hello @jwyang. Thank you again for the amazing work. I would like to refer my earlier posted issue here: [Evaluation and Finetuning Scripts](https://github.com/microsoft/Magma/issues/78). I am getting the same error as...
Surprisingly enough, the inference codes are working fine with all the following transformer versions: the default one you get when setting up the magma environment first (4.51.3), the versions mentioned...
Added `np.random.seed(0)` at the beginning, and `sampler=outlines.samplers.greedy()` to `outlines.generate.json()` to get deterministic output. I have a few questions though. Kindly answer them: 1. Since `outlines` changes the sampling technique, is...