hieuchi911

icon indicating a website link https://hieuchi911.github.io/

icon location Dreaming in the high dimensional space 🌌

Results 1 issues of hieuchi911

[MiniLLM] teacher generated responses `gen_answer` not used in seqKD

2 comment

I'm running sequence level KD of llama. And in the first step of generating responses with teacher: - Generate responses with the teacher: ``` bash scripts/llama/tools/generate_data_seqkd.sh /PATH/TO/MiniLLM bash scripts/llama/tools/process_pseudo_data_seqkd.sh /PATH/TO/MiniLLM...