ydy
ydy
my windterm version is 2.4.1 , custom linux base on centos7, vim have some problems, like this:  [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c [?0c[?1c...
same question
SGLang version is : >>> import sglang >>> sglang.__version__ '0.5.2'
the draft model's config.json is: { "architectures": [ "LlamaForCausalLMEagle3" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 151643, "draft_vocab_size": 32000, "eos_token_id": 151645, "head_dim": 128, "hidden_act": "silu", "hidden_size": 5120, "initializer_range": 0.02, "intermediate_size": 13824,...
@justadogistaken Thank you for your concern. However, my draft model is quite large — even after compression it’s about 800MB, so uploading and downloading might not be very convenient. Could...
@jiapingW Let me take a look into it.
@jiapingW It works, thanks a lot!