letta
letta copied to clipboard
offline mode not working (+ suspicious network calls from dependencies)
Describe the bug I'm using MemGPT in local only mode and every time it is run either through the CLI or Python, several network calls are made to Cloudflare and Microsoft servers. The program even occasionally gets blocked or even crashes until I allow these requests to go through. What is the reason for these calls?
Please describe your setup
- [x] How did you install memgpt?
-
pip install pymemgpt
-
- [x] Describe your setup
- MacOS
- Terminal, Python library
If you're not using OpenAI, please provide additional information on your local LLM setup:
Using Ollama backend
Can you provide more details on the requests you're seeing? MemGPT is not using external servers if you are using local LLMs, however its possible a library we're depending on is.
I'm using LuLu as a firewall and it notified me of these requests. They usually occur when running MemGPT (like memgpt run ...
). Around 7 KB and 16 KB of data are uploaded and downloaded respectively, mainly from AWS CloudFront servers. I haven't captured any packets so far.
Closing since this since it's likely an issue with one of our dependencies, but happy to chat further to isolate the source of the network requests on discord.
I don't think this should be closed until the program can run offline without issues. It currently either hangs for at least 15 minutes or outright crashes.
Gotcha @Kodmod we didn't realize there were issues with running offline, just that there were unknown network calls being made by some dependencies (realizing now on re-read that's what you implying in the OP). Will look into this and close with a fix or if we are unable to reproduce the offline run issue. Thanks!