Jiangze Hu
Jiangze Hu
量化版(int8)相比量化前推理时间增加了一倍 https://huggingface.co/THUDM/chatglm-6b-int8/discussions/1
同问
看日志应该是拆成一句话一句话转的,这样不可避免每句话的音量无法对齐,看 @Zengyi-Qin 的回复是做后处理如标准化等 这个工作其实应该项目内部处理,而不是交给用户,用户拿到整段音频是不能做处理的,需要改中间实现的代码分句音频处理
> You can see a short example of loading in a saved model and executing a function from it in the TF-Java test suite (https://github.com/tensorflow/java/blob/master/tensorflow-core/tensorflow-core-api/src/test/java/org/tensorflow/SavedModelBundleTest.java#L285), and there are many more...