leoterry

Results 15 comments of leoterry

> This can be done with: > > ``` > curl http://localhost:11434/api/generate -d '{"model": "llama2", "keep_alive": 0}' > ``` > > To effectively unload a model (assuming `llama2` is loaded)...

Also encountered the same problem, how to solve this problem? @viktor-ferenczi @WoosukKwon

> To address the issue with modifying the retrieval method in Dify version 0.6.8, ensure your Docker environment is correctly set up with the required versions and resources. Verify that...

@imoneoi +1 for function calling.

> @xxm1668 https://github.com/ModelTC/lightllm/blob/main/lightllm/server/api_server.py here when the function call feature is supported???