Alexander

Beim Testen aufgefallen: docker-compose*.yml sollten eigentlich die docker.conf als env-file verwenden. Ansonsten müssen up befehle stattdessen installOdcdocker.sh verwenden

I found the problem: dolly uses uint8 datatypes and they are not mapped. I think it is a byte Tensor which maps to uint8 which causes the problems

yeah that is an other issue: the tokens for dolly are in json format and convert handles some other format.

yes, see closed PR: https://github.com/ggerganov/llama.cpp/pull/1308

and there seems to be a transition to httpx so your code would be more interoperable

everyone has his own library preferences ;). It is just my recommendation.

thanks! And sorry for the duplicate Found another frustrating bug: requests.Session is incompatible with asgi/wsgi

an idea: you have the method get_requests_kwargs. Check if the class is requests.Session or httpx.Session and transform the arguments accordingly or remove if not supported. This way httpx Session can...

added the problem with the missspelling of asgi

- the base_url problem: django checks the hostname. e.g. ALLOWED_IPS = ["secretgraph.net"] can be only accessed if the hostname is secretgraph.net. - the client ip address is set to testclient...