Seung Ho Jang

Hello, I'm trying to load weights from pretrained model.safetensors file, and I have a question(or maybe feature request). This is part of the code I wrote. ``` // vs: VarStore...

[Bug] Cannot compile custom wasm model file to work on web browser

3

## 🐛 Bug Hello, I am trying to convert my own model type based on llama2 to compille to work on wasm, but I cannot make it to work whatever...

Memory usage is doubled when loading a fp16 model into bf16

2

### Description ```shell Model: Gpt-NeoX GPU: A100 Tritonserver version: 22.12 ``` Hello, I'm not sure whether this is FasterTransformer's issue or backend's issue, but still I'm reporting it here. As...