djl-serving icon indicating copy to clipboard operation
djl-serving copied to clipboard

setting env variable by using serving.properties file

Open eduardzl opened this issue 9 months ago • 2 comments

Hello. Is there any way I can set set environment variable for the djl-serving container by using serving.properties file ? I would like to set VLLM_USE_V1=0 but by modifying serving.properties configuration file. Thank you.

eduardzl avatar Mar 27 '25 16:03 eduardzl

@eduardzl

Yes, you can do that:

option.env=KEY1=VALUE1,KEY2=VALUE2

frankfliu avatar Apr 01 '25 02:04 frankfliu

@frankfliu Thank you, it is really helpful.

eduardzl avatar Apr 01 '25 09:04 eduardzl