djl-serving
djl-serving copied to clipboard
setting env variable by using serving.properties file
Hello. Is there any way I can set set environment variable for the djl-serving container by using serving.properties file ? I would like to set VLLM_USE_V1=0 but by modifying serving.properties configuration file. Thank you.
@eduardzl
Yes, you can do that:
option.env=KEY1=VALUE1,KEY2=VALUE2
@frankfliu Thank you, it is really helpful.