dongdong
dongdong
按我测试的 7b 的 fine-tune 来看，你这肯定不够。 V100本身不支持 bf16， 于是内存加载差不多就是 7*4 = 2 8 多了。微调差不多Double，也就是两倍的量。 如果不出意外，最少是 50 几个 G。 实际上，我估计单张 A100 80G 显存可以。
国内还是百度网盘好用，这个模型真的非常不错，非常感谢。
I've try to reolve it. maybe some env problems.
got some clues, it's okay to turn off GTEST now. cmake -G Ninja -B ../iree-build/ . -DIREE_BUILD_TESTS=OFF cmake --build ../iree-build/ can' build and run the source .
[logout.txt](https://github.com/user-attachments/files/20405025/logout.txt) “The attachment contains the complete compilation output to the console.”