Eduard Zl

icon location Israel

Results 6 comments of Eduard Zl

[Installation]: Could not find a version that satisfies the requirement xgrammar>=0.1.6; platform_machine == "x86_64" (from vllm) (from versions: none)

Also not working for me on Amazon Linux 2. Trying to install vLLM 0.6.6.post1 The latest version of glibc available is 2.26. When trying to compile glibc 2.29 from source,...

[Installation]: Could not find a version that satisfies the requirement xgrammar>=0.1.6; platform_machine == "x86_64" (from vllm) (from versions: none)

@russellb Getting error when trying to compile xgrammar. `[11/30] Building CXX object CMakeFiles/xgrammar.dir/cpp/grammar_matcher_base.cc.o FAILED: CMakeFiles/xgrammar.dir/cpp/grammar_matcher_base.cc.o /usr/bin/c++ -I/home/ec2-user/SageMaker/vllm/xgrammar/3rdparty/picojson -I/home/ec2-user/SageMaker/vllm/xgrammar/3rdparty/dlpack/include -I/home/ec2-user/SageMaker/vllm/xgrammar/include -Wall -Wextra -Werror -Wno-pedantic -Wno-unused-parameter -Woverloaded-virtual -flto=auto -Ofast -O2 -g -DNDEBUG...

DJL running without speculative decoding

@siddvenk Thank you, will try that.

setting env variable by using serving.properties file

@frankfliu Thank you, it is really helpful.

GRPO training on structured data

@ved1beta Thanks fotr reply. After removing type: chat_template I getting another error. ``` Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code...

Default values for inference from generation_config.json are not being applied

@siddvenk Hello, can you share when the next release is scheduled ?