Yunzhen He

About "HTTPError: 404 Client Error" and "OSError: meta-llama/Llama-2-7b does not appear to have a file named config.json".

4

I encountered those errors when I was downloading Llama-2-7b from huggingface. I have full permission for using Llama-2 models and also did `huggingface-cli login`.

Make word color Green

2

We can use \alert{} to make word color orange. But how can make it green, like in the demo slide (p.14 left).

Should apply model.norm layer to hidden_states[early_exit_layer] ?

1

https://github.com/voidism/DoLa/blob/dc88907406f9744f748f3c779f2353efd5bdc824/transformers-4.28.1/src/transformers/models/llama/modeling_llama.py#L703 I think you guys should apply model.norm layer to hidden_states[early_exit_layer] . Because only the last hidden_state applied model.norm layer. See https://github.com/voidism/DoLa/blob/dc88907406f9744f748f3c779f2353efd5bdc824/transformers-4.28.1/src/transformers/models/llama/modeling_llama.py#L594