Jonathan Yankovich

Results 99 comments of Jonathan Yankovich
trafficstars

This is fan freaking tasktic! An additional feature to consider: If we had the ability to do training runs via command line or via a simple python api, it would...

This is a general problem how text-generation-ui is using Gradio. The gradio interface can't close because something in server.py is holding onto a gradio memory structure. The fix is to...

This is great, thank you both > force a part of the UI to update via a function, What's puzzling to me about this is that the whole thing is...

Gradio is so widely used, and the session management documented so well, that I have to think what we need is well-supported; it probably just hasn't been a design concern...

@tigerbears @bmoconno @brandonj60 Thanks for all the legwork and posting your progress. I just spent a decent amount of time researching this and I've come to similar conclusions and strategies...

I'm in a similar boat and it sounds like we're pretty aligned, maybe we'd do well to collaborate real-time via slack/discord?

You can see a description of how the API works [here](https://github.com/oobabooga/text-generation-webui/blob/main/api-example.py#L20) The character's identity is given by the prompt, and the prompt is basically a concatenation of the context and...

> DIY gpt4 plug-ins Beyond DIY, I see it more as a generalized API for models to talk to each other, talk to the outside world, and be talked to....

[This fellow ](https://www.youtube.com/watch?v=J_0qvRt4LNk)is making some great tutorial videos on LangChain, which could be a good introduction. It looks hecka powerful. The third or fourth video in the series uses ReAct...

Only thing I've seen so far is this: ``` llm = SelfHostedHuggingFaceLLM(model_id="gpt2", hardware=gpu, model_reqs=["pip:./", "transformers", "torch"]) ``` Found [here](https://python.langchain.com/en/latest/modules/models/llms/integrations/self_hosted_examples.html) It looks like `SelfHostedHuggingFaceLLM` is the class to check out. If...