排气扇
排气扇
Can you provide the code to measure Head accuracy?
I just tested gen_model_answer_baseline.py and gen_model_answer_medusa.py. Medusa can be generated normally, but there are some problems with gen_model_answer_baseline.py. Can you run this py file normally?
OSError
python gen_model_answer_baseline.py --model-path /data/transformers/vicuna-7b-v1.3 --model-id vicuna-7b-v1.3-0 python gen_model_answer_medusa.py --model-path /data/transformers/medusa_vicuna-7b-v1.3 --model-id medusa-vicuna-7b-v1.3-0 My vicuna-7b-v1.3 download comes from:https://huggingface.co/FasterDecoding/medusa-vicuna-7b-v1.3/tree/main My medusa-vicuna-7b-v1.3 download comes from:https://huggingface.co/FasterDecoding/medusa-vicuna-7b-v1.3/tree/main I used this command to add the local...