44670
44670
好的,我们目前的主要精力还在训练模型上面!文档的话也有完善的计划。 目前可以考虑使用Langport框架进行推理,可以参考它们的项目的文档。我们自研的推理框架还在开发后,完成后会提供相关文档。 关于不同版本的差别和优势,这个其实我们自己也不是很清楚,我们有一套内部的测试题,但是这显然只能反映模型一部分的差异,发出来会导致误导。 所以目前我们还是希望用户能够自己测试多个模型(而不是对模型版本有先入为主的印象),并体验其中的差异后分享给我们,我们在discord上开放了很多版本的频道,欢迎测试。
I have solved the conflict introduced in the recent commits, it should be meragable again for now.
I have made additional improvements to the implementation. Now, setting `kwargs["torch_dtype"] = torch.bfloat16` and displaying a console warning message will only occur when the model path contains `-bf16`. If there...
Thanks for pointing out! I have submitted a pull request to the FastChat project with support for the OpenBuddy model, hoping to see this model on the arena! https://github.com/lm-sys/FastChat/pull/655
Thank you for merging the Pull Request! If you need an early test version of the 13B model or other formats of the 7B model for the Model Arena project,...
> Thanks! I will let you know if we need help. We are also thinking about providing APIs for you so you can self-host the model and participate. We'd be...
Hi! We are excited to inform you that our OpenBuddy 13B model has been updated to `version 1.2`, now including an `FP16` variant. This means that it can now be...
Hi! I am delighted to share with you the recently released OpenBuddy 13B v1.3 model, which is in FP16 format: https://huggingface.co/OpenBuddy/openbuddy-13b-v1.3-fp16 We have verified it on a V100 without encountering...