MingYang

icon indicating a website link https://puitar.github.io/

icon company Fudan University, Shanghai icon location Shanghai, China icon location I'm very interested in LLM, RAG, ML etc.

Results 1 issues of MingYang

Update finetune.py

```python def __init__( self, data_path, tokenizer, model_max_length=4096, user_tokens=[1786, 4194, 95388], assistant_tokens=[1786, 10850, 95388], ): ``` We try to do sft on `MiniCPM-1B-sft-bp16`, but there is an error, because the token...