Pan Yinxu

可以使用tokenizer.apply_chat_template来做模板处理，供参考。 ``` from transformers import AutoTokenizer import json tools = [ { "type": "function", "function": { "name": "get_delivery_date", "description": "Get the delivery date for a customer's order. Call this whenever...

> Thanks. I'd been trying to use it (and having problems) so I wanted to make sure it was still "valid". > > Turns out my problem was really that...

I have the same problem, and I solve this by using the following script to convert the FSDP checkpoint to huggingface checkpoint. The evaluation results seem correct, but I don't...

[minicpm3-4b-result.zip](https://github.com/user-attachments/files/16972499/minicpm3-4b-result.zip) [minicpm3-4b-score.zip](https://github.com/user-attachments/files/16972504/minicpm3-4b-score.zip) Here are my evaluation results and score.

same issue. Any solutions?

> I try to fix OOV problem in this Issue through logits processor, but it is not supportted by V1 engine. [#13360](https://github.com/vllm-project/vllm/pull/13360) I really want to know how to solve...

``` max_token_id = max(self.tokenizer.get_vocab().values()) kwargs["allowed_token_ids"] = list(range(max_token_id + 1)) ``` Something like this, in vllm_rollout_spmd.py, before update_sampling_params.

When will this feature be merged into the main branch?

可以使用https://github.com/OpenBMB/MiniCPM/blob/main/demo/minicpm3/function_call/openai_api_server.py 来启动一个支持function call的vllm server