cmp-nct
Is there any GUI or Web UI for ggllm.cpp?
We'll definitely need something like that. Though I've a ton of features and ideas to try and only 15 hours a day time.
It will have to wait for a bit, or someone else ports that.
Thanks @cmp-nct
I have a simple UI based off the official Falcon space uusing ggllm via ctransformers: https://huggingface.co/spaces/matthoffner/falcon-mini
I've been building spaces on HF using ggml fastapis, I have a boilerplate repo I'm working off here https://github.com/matthoffner/ggml-fastapi
A modified falcon_server.cpp is as following. It can help you to build web-ui by http api. server_code.zip
I have a simple UI based off the official Falcon space uusing ggllm via ctransformers: https://huggingface.co/spaces/matthoffner/falcon-mini
FYI, just errors out at the moment..
I have a simple UI based off the official Falcon space uusing ggllm via ctransformers: https://huggingface.co/spaces/matthoffner/falcon-mini
FYI, just errors out at the moment..
Feel free to open an issue, it might scale down when its not being used.
I meant a windows gui app or a local offline web ui that can be opened in Microsoft Edge etc.
From my current roadmap view I'll see into performance optimizations as next step and once that is done I'll look into the best way to quickly add accessibility through a web frontend.
I started working on a fork of llama-cpp-python for ggllm.cpp, but it's not working yet. Anyone that wants to help is more than welcome. falcon-cpp-python
I started working on a fork of llama-cpp-python for ggllm.cpp, but it's not working yet. Anyone that wants to help is more than welcome. falcon-cpp-python
I think that rather than MORE forks and confusion, you might just pull from llama-cpp-python, and help make that work for both llama and falcon models. They are already working on that. Just a suggestion. I will be testing later this week on some of pre-requisites.
I should bring a word of caution: we'll see huge changes with the next release. More than all previous updates combined. If time permits it will already include a minimal web-based GUI that can then be further developed/extended. I expect it to be finished within a week, though my time planning usually is off
It seems LocalAI has support for ggllm already. (Did not try this out yet.) As it offers an OpenAI API compatible interface, you can use it in conjunction with any web-based client such as chatbot-ui.
