Ettore Di Giacinto

> Do the SHA256 checksums in the release announcements not cover this? > > Example: https://blog.rubygems.org/2018/12/19/3.0.0-released.html Hi, thanks for looking at this. Not exactly. That would be a problem in...

> It's an issue of https://github.com/rubygems/rubygems.org, not rubygems/rubygems that is client software. Depends, the sha256 checksum could be also provided as part of a Github release. Anyway, opened an issue...

good points here, and lots of room for improvements. currently we have a fairly basic handling by setting `LOCALAI_SINGLE_ACTIVE_BACKEND` to true - this will basically make sure to have only...

> > > Implement "ageing" for model states in memory tracking the last interaction with their consumer to proactively free resources for new tasks incoming by demoting layers to system...

@copilot add the new preferences to the common preferences of the model-editor import section

@copilot be consistent and use yaml/v3

Makes sense, definitely we can add this.

@copilot try to address additionally also these points: - Empty finish_reason: LocalAI sends "finish_reason": "" instead of "stop" or null - Empty initial chunks: Sends empty content chunks that cause...

@copilot we shouldn't omit finish_reason, it should be either having a value string (e.g. "stop") or null, see this example: ``` data: {"id":"chatcmpl-blablabla","object":"chat.completion.chunk","created":1684665888,"model":"gpt-4-0314","choices":[{"delta":{"role":"assistant"},"index":0,"finish_reason":null}]} data: {"id":"chatcmpl-blablabla","object":"chat.completion.chunk","created":1684665888,"model":"gpt-4-0314","choices":[{"delta":{"content":"1"},"index":0,"finish_reason":null}]} data: {"id":"chatcmpl-blablabla","object":"chat.completion.chunk","created":1684665888,"model":"gpt-4-0314","choices":[{"delta":{"content":" "},"index":0,"finish_reason":null}]} data: {"id":"chatcmpl-blablabla","object":"chat.completion.chunk","created":1684665888,"model":"gpt-4-0314","choices":[{"delta":{"content":"2"},"index":0,"finish_reason":null}]}...

I tried before going to sleep to offload this to copilot.. but then you wake up and you see that it derailed entirely.. now let's watch it trying to make...