garycao

icon indicating a website link https://github.com/Qihoo360/360zhinao

icon location Beijing china icon location ai programmer maintainer of 360zhinao email: gary.caokai at gmail.com

Results 2 issues of garycao

[Model] Add support for 360zhinao

16 comment

Add support for [360zhinao](https://github.com/Qihoo360/360zhinao) model We released the 360Zhinao model series: - **360Zhinao-7B-Base** - **360Zhinao-7B-Chat-4K** - **360Zhinao-7B-Chat-32K** - **360Zhinao-7B-Chat-360K** Notable features of our 360Zhinao models are: - **Base Model:** Leveraging...

[Bug]: Performance : slow inference for FP8 on L20 with 0.5.1(v0.5.0.post1 was fine)

6 comment

### Your current environment ```text Collecting environment information... PyTorch version: 2.3.0+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build PyTorch: N/A OS: Ubuntu 22.04.4...

bug