lxp3
lxp3
It appears that simple-sentencepiece is unable to tokenize UTF-8 strings (BBPE CJK) correctly. Python Example 1: Google's sentencepiece works fine. This code successfully produces the expected BPE tokens: ['▁ƋţŅ', '▁ƌŋţ',...
> @hx621 you can check this sample and related codes. https://github.com/NVIDIA/TensorRT/tree/release/9.0/demo/Diffusion#generate-an-image-guided-by-a-text-prompt-and-using-specified-lora-model-weight-updates Unfortunately, there is still a lack of solutions for dynamic Lora fusion. A feasible but heavy workaround is to...
> > > @hx621 you can check this sample and related codes. https://github.com/NVIDIA/TensorRT/tree/release/9.0/demo/Diffusion#generate-an-image-guided-by-a-text-prompt-and-using-specified-lora-model-weight-updates > > > > > > Unfortunately, there is still a lack of solutions for dynamic Lora...