memery
memery copied to clipboard
Give GUI its own flow
The streamlit GUI should keep the db and CLIP model loaded while the folder doesn't change. This probably necessitates writing its own Flow, I guess? Maybe with native widgets for dipslaying errors and progress bars and such
Does the streamlit caching feature and the .ann and .pt files address this or no?
Not sure... we're still loading CLIP and rebuilding the db each time we change files in the folder and hit the "Index" button. But when we search, we're just checking the db and treemap to make sure they're there. But we're still reloading them into memory each time, and still loading CLIP anew in the Ranker to embed the query.
Oh yeah I think I understand this better now. Keeping those things in memory could improve speed a bit.