lone-cloud
Remote Tunnel not working
LLM does not load when Remote tunnel option is turned on.
***
Version 1.102.3
Downloading https://github.com/cloudflare/cloudflared/releases/latest/download/cloudflared-darwin-amd64.tgz
tar: Error opening archive: Failed to open 'cloudflared-darwin-amd64.tgz'
chmod: cloudflared: No such file or directory
curl failed: Command '['curl', '-fLo', 'cloudflared-darwin-amd64.tgz', 'https://github.com/cloudflare/cloudflared/releases/latest/download/cloudflared-darwin-amd64.tgz';]' returned non-zero exit status 56.
Could not find suitable download software, or all download methods failed. Please install aria2, curl, or wget.
Attempting to start tunnel thread...
and ends in...
Load Text Model OK: True
Llama.cpp UI loaded.
======
Active Modules: TextGeneration
Inactive Modules: ImageGeneration VoiceRecognition MultimodalVision MultimodalAudio NetworkMultiplayer ApiKeyPassword WebSearchProxy TextToSpeech VectorEmbeddings AdminControl
Enabled APIs: KoboldCppApi OpenAiApi OllamaApi
Error: Could not create cloudflare tunnel!
More Info:
/bin/sh: ./cloudflared: No such file or directory
Thanks for porting this from reddit. I'll take a look later today and this should be working with the next gerbil release (fingers crossed).
Tunneling doesn't work on my machine because kcpp is bundling this old readline.so library which clashes with my very modern Arch OS. I previously ran into this issue, but it would be a big pain to solve as I'd need to create PRs in kcpp like https://github.com/LostRuins/koboldcpp/pull/1725
I need to test it some more, but I've re-implemented a separate cloudflared implementation in gerbil that will add a new icon with a "copy tunnel URL" on click. The end result is that koboldcpp implementation will not be used, which I believe will make the tunnel startup much faster and avoid those rl_print_keybinding Linux nightmares.
This functionality has now been released in the latest v1.15.0 release. Feel free to close this issue if it works well for you.
This functionality has now been released in the latest v1.15.0 release. Feel free to close this issue if it works well for you.
I tested this. It works well.