letta icon indicating copy to clipboard operation
letta copied to clipboard

offline mode not working (+ suspicious network calls from dependencies)

Open Kodmod opened this issue 11 months ago • 5 comments

Describe the bug I'm using MemGPT in local only mode and every time it is run either through the CLI or Python, several network calls are made to Cloudflare and Microsoft servers. The program even occasionally gets blocked or even crashes until I allow these requests to go through. What is the reason for these calls?

Please describe your setup

  • [x] How did you install memgpt?
    • pip install pymemgpt
  • [x] Describe your setup
    • MacOS
    • Terminal, Python library

If you're not using OpenAI, please provide additional information on your local LLM setup:

Using Ollama backend

Kodmod avatar Mar 12 '24 20:03 Kodmod

Can you provide more details on the requests you're seeing? MemGPT is not using external servers if you are using local LLMs, however its possible a library we're depending on is.

sarahwooders avatar Mar 14 '24 21:03 sarahwooders

I'm using LuLu as a firewall and it notified me of these requests. They usually occur when running MemGPT (like memgpt run ...). Around 7 KB and 16 KB of data are uploaded and downloaded respectively, mainly from AWS CloudFront servers. I haven't captured any packets so far.

Kodmod avatar Mar 14 '24 21:03 Kodmod

Closing since this since it's likely an issue with one of our dependencies, but happy to chat further to isolate the source of the network requests on discord.

sarahwooders avatar Mar 18 '24 22:03 sarahwooders

I don't think this should be closed until the program can run offline without issues. It currently either hangs for at least 15 minutes or outright crashes.

Kodmod avatar Mar 19 '24 06:03 Kodmod

Gotcha @Kodmod we didn't realize there were issues with running offline, just that there were unknown network calls being made by some dependencies (realizing now on re-read that's what you implying in the OP). Will look into this and close with a fix or if we are unable to reproduce the offline run issue. Thanks!

cpacker avatar Mar 19 '24 19:03 cpacker