Andy Salerno

Add api_streaming extension and update api-example-stream to use it

10

I'm back with another possible enhancement to the streaming api :) This time, I duplicated the "api" extension, but instead of an HTTP server I implemented a simple websocket server....

hub_strategy + saves_per_epoch not pushing saves to hub

2

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior with `hub_strategy: "every_save"` and `saves_per_epoch:...

Misc. bug: server provides strutured output for response_format: json_object, but not for response_format: json_schema

3

### Name and Version on latest commit ce8784bdb153ff7794dde5a50b0ebfa51baa6171 but have been noticing it for several days now ### Operating systems _No response_ ### Which llama.cpp modules do you know to...