Alex Arseneau comments

Repositories
Issues
Comments

Results 2 comments of


                                            Alex Arseneau

LocalAI use only 100% CPU (one Core) for Rebuild and Could not release VRAM when not use model

If you're using the docker container, set the environment variable BUILD_PARALLELISM to specify the number of CPU cores to use.

LocalAI use only 100% CPU (one Core) for Rebuild and Could not release VRAM when not use model

You can see the code here: https://github.com/mudler/LocalAI/blob/1c708d21de87371bb17c27e2615aa352e9ac5790/entrypoint.sh#L18 It's the number of threads you want to use when building/rebuilding. You need to pass it as an environment variables when creating the...