FreedomGPT Use Multi-Core performance and run-in-background

I recently tried out the FreedomGPT app on Windows. my specs: CPU: Intel i9-10900K 3.70GHz 20 CPUs 16 RAM Graphics: NVidia GeForce GTX 1660 SUPER

i tried typing a command which fits 2 lines, so 25+ words. but the AI didn't even start typing. it was just on hold. I checked the GPU and it was not even using 10% of my GPU. and nothing of my CPU. ideally it'd use both to the maximum extend.

also i noticed that when minimizing the app the GPU consumption ends completely. so it's kind of paused. ideally it should run in background so that you can at least watch a video or search something in the browser whiel you're waiting for a response.

i think a lot of potential users have no ML machine, so it'd make sense to optimize. i hope what i suggest is not too complicated. please give me some feedback.

Apr 22 '23 17:04 Kokujou

oh right, it's using only 4 threads. ill fix and pr it soon.

Apr 22 '23 18:04 ItsPi3141

wow :o that'd be awesome. can you also do something about it not running if minimized/in background?

Apr 22 '23 21:04 Kokujou

wow :o that'd be awesome. can you also do something about it not running if minimized/in background?

Can't say for sure. I might not have time to do it.

Apr 22 '23 23:04 ItsPi3141