Add streaming responses to web UI

[ErikBjare]

This might require significant rewrite of how tokens are output, turning the request into a generator that emits tokens instead of a full message. The tokens can then be collected until an end of message token, returned over the API, while being consummated into a message at the end.

[nslieske]

In my opinion, the web interface should be a lower priority. The tool works very well on the command line, so to divert your efforts towards a web UI is not efficient. If someone else wants to step up, then it makes sense. What's the motivation for the web interface at all?

[ErikBjare]

It is a lower priority :)

It's not that much of a distraction, the changes required would improve the code overall anyway.

The web UI is nice for browsing past conversations, and in theory it'd be nice if it could act like a Jupyter-notebook style thing with inline plots and such. But you're right, I'm not going to divert significant efforts towards it right now.