Xin Liu

feat: introduce server-assistant

1

Major changes: - Introduce `server-assistant` app - `PUSH` server info to the target URL specified by `server_info_url` field in `config.json` - `PUSH` server health periodically to the target URL specified...

feat: Provide a `whisper & piper` combo plugin

2

### Summary There is a solid requirement from [whisper-api-server](https://github.com/LlamaEdge/whisper-api-server) to use `whisper` and `piper` plugins at runtime. ### Details There is a solid requirement from [whisper-api-server](https://github.com/LlamaEdge/whisper-api-server) to use `whisper` and...

feat: support `audio translations` feature in whisper plugin

2

### Summary The latest whisper plugin has already supported `audio transcriptions` feature. The `audio translations` feature is also required for providing `/v1/audio/translations` endpoint in llama-api-server. It is expected to support...

feat: Update `stable-diffusion` plugin to `master-64d231f` or above

1

### Summary The [FLUX.1-schnell](https://huggingface.co/second-state/FLUX.1-schnell-GGUF) has already supported by stable-diffusion.cpp. To support the model in `stable-diffusion` plugin, it is necessary to upgrade to `master-64d231f` or above. ### Details Upgrade `stable-diffusion` plugin...

Bug: Failed to convert minicpm-v2.5

4

### What happened? Follow the steps in [README-minicpmv2.5.md#usage](https://github.com/ggerganov/llama.cpp/blob/master/examples/llava/README-minicpmv2.5.md#usage) to convert `minicpm v2.5`. The conversion process fails while running the command: `python ./convert_hf_to_gguf.py ../MiniCPM-Llama3-V-2_5/model`. Specifically, the error happened after input `y`...

### Summary According to whisper.cpp, `max-context` defaults to `-1`. However, the `max-context` param of whisper plugin is of type `uint64_t`. The relevant code snippet: https://github.com/WasmEdge/WasmEdge/blob/master/plugins/wasi_nn/whispercpp.cpp#L285-L294 ### Current State _No response_...

### Summary The `max-len` and `split-on-word` config params for whisper plugin does not work. The test code can be found [here](https://github.com/second-state/WasmEdge-WASINN-examples/blob/test-whisper/whisper-basic/src/main.rs#L15-L21). The test was run with [whisper-0.14.1-plugin-lts-8a2d406](https://github.com/second-state/WasmEdge-plugin-registry/releases/tag/whisper-0.14.1-plugin-lts-8a2d406). whisper.cpp v1.7.1 shows...

feat: `piper` and `chattts` plugins for the `Apple Silicon` platform

3

### Summary To verify `tts-api-server`, it is necessary to have `piper` and `chattts` plugins for the `Apple Silicon` platform. `piper` plugin is of high priority. In addition, the plugins should...

### Summary To verify the capability of concurrency, designed a tiny server wasm app. When perform stress test against the app (using postman), a segfault error is raised. The test...

MiniCPM-V-2.6 promp template的明文格式？

3

请教一下，MiniCPM-V-2.6 promp template 具体的明文格式是什么样的？是否可以提供一个具体的例子？下面是猜测的多轮对话的chat template，不知道是否正确？谢谢！ ```text system {system_message} user {user_message_1} assistant {assistant_message_1} user {user_message_2} assistant ```