Shannon Shen

It should be this file - https://github.com/lolipopshock/Detectron2_AL/blob/7eb444e165f1aea6b3e1930ba0097dcaadf4c705/annotating/config.xml You might want to change `extra/config.xml` to `annotating/config.xml`.

Thank you! I am researching how to make the decimal digits an adjustable parameter.

> When I run the bash scripts/evaluation/gsm8k/deferral_generate.sh script, I keep seeing the message "Checking again..." repeatedly. I am not sure what this means or how to resolve it. This means...

For the 2nd step, > python collm/eval.py eval_folder --task_name gsm8k --orig_data_path static_eval-completion/gsm-0shot/validation --pred_data_folder /space/hecb/co-llm-main/checkpoints/generate/gsm8k-finetuned/gsm-0shot/gsm8k-def-finetuned-Llama-2-7b+EleutherAI@llemma_7b/_deferral_search You need to run deferral search (see https://github.com/clinicalml/co-llm/blob/d83ab8cf19ceb49c7814383a897089e51cdeebfe/scripts/evaluation/generic/deferral_generate.sh#L54) so it will create the individual folders in...

I think in this case, you might be running co-llm with a model other than the llama based model (tokenizer)? I am a bit unsure why you have index `50118`...

OK I think I find the issue: In your code: There are some spaces after the `\` for some lines, indicated by the screenshot above. In that case, bash would...

Hey @hechengbo-H ! Sorry for the delayed response -- re your questions: > As you mentioned, the models with 64bz do not perform well because they have many instances of...

Closing b/c of inactivity; free feel to reopen for more questions.

> > 解决了网络问题后，我遇到了一个新的问题。  > > How did you solve the out of bounds problem? Sorry I am not sure if I follow your question here -- what's the "bounds...

Thank you for the kind words! Yeah I'd love to make it work to mobile platforms -- there are some intricacies due to file systems and hopefully it might work...