Play-with-LLMs
Play-with-LLMs copied to clipboard
EvilPsyCHo
Tutorial on training, evaluating LLM, as well as utilizing RAG, Agent, Chain to build entertaining applications with LLMs.分享如何训练、评估LLMs，如何基于RAG、Agent、Chain构建有趣的LLMs应用。
when i try to train the model，It was all normal at first，but some times later ,it get a strange mistake，how can i solve it 
关于输入
我有一点疑惑，请问为什么没有mask将instruction+input 的损失mask掉。看代码的意思是输入为instruction+input+output,然后预测目标也是instruction+input+output。
对于CUDA大于等于12.0的，需要直接安装bitsandbytes最新版本（我这边显示不兼容）：pip install -U bitsandbytes 除了requirements.txt里的，还要安装其他包：datasets、sentencepiece、scipy
This repo with videos is helpful to me. Nevetheless, I still met some issues. May the following tips save your time. 1. [**Linux:Yes, Windows:No**] Bitsandbytes is officially maintained on Linux....
Metadata
Owner
Metadata
Tutorial on training, evaluating LLM, as well as utilizing RAG, Agent, Chain to build entertaining applications with LLMs.分享如何训练、评估LLMs，如何基于RAG、Agent、Chain构建有趣的LLMs应用。