JerryDaHeLian

ncclRemoteError

1

Who can help me？

RuntimeError: Expected x1.dtype() == cos.dtype() to be true, but got false. (Could this error message be improved? If so, please report an enhancement request to PyTorch.)

2

When I Pre-train LLaMA, there is a error: File "/usr/local/lib/python3.8/dist-packages/torch/autograd/function.py", line 551, in apply return super().apply(*args, **kwargs) # type: ignore[misc] File "/home/xxx/TinyLlama/lit_gpt/fused_rotary_embedding.py", line 39, in forward rotary_emb.apply_rotary( RuntimeError: Expected x1.dtype()...

Can I use Lightning fabirc to pre train llama2 on v100?

1

到底能不能在v100上使用Lightning fabirc 预训练llama2？

能做到类似助力那样实时交互对话吗？

比如：运行系统最低配要求是，GPU型号？内存大小？显存大小？cpu型号？硬盘大小？操作系统？等等

关于许可证

1

我看许可证是GPL-3.0 license的，也就是说基于开项目进行商用开发的话，必须公布源码，请问是这样的吗？还是随便用？