Dave

gpu + transformers-musicgen

3

it's been reported in discord that transformers-musicgen needs some changes to fully support GPU * https://github.com/mudler/LocalAI/blob/master/backend/python/transformers/backend.py * It's already implemented in transformers * https://github.com/huggingface/transformers/issues/2704 * this may be useful reference...

feat: Centralized Request Processing middleware

3

This PR reworks how our endpoints parse and process user input, in order to centralize and commonize that code as much as possible. This will drastically cut down the endpoint-specific...

Proposal: Migrate gRPC / protobuf definition files to their own repo

4

Part of the CI Speedup Project https://github.com/users/dave-gray101/projects/2/views/1 In order to _really_ accelerate CI, I want to build backends only when a relevant change is made to them. The first step...