kobe2000

> > > Could you please explain what exact problem do you have with those messages? In my opinion, the web server should ignore data outgoing IO exceptions, or log...

I am facing the same problem, any solution yet?

> We are more focused on CSP/actor-based programming paradigms Hi, did you mean actor programming can eliminate RW mutex?

Could you please give me some hint how to use actor-style programming avoiding RW lock in such situation: I use a large collection in memory(GBs), and it needs to support...

> Anything that changes how model resources are allocated will cause a model reload. Size of context (`num_ctx`), number of layers (`num_gpu`), memory mapping (`use_mmap`), memory locking (`use_mlock`), threads (`num_thread`)....