LocalAI
LocalAI copied to clipboard
OUTDATED: Service Wiring / Concurrency pt 1
This PR is the start of transitioning our core services to the core/application.go \ core/startup model. In order to keep things reviewable, this PR will have a limited scope - rather than moving everything at once, my goal is to select services that are covered by existing tests for the detection of regressions. Therefore, this PR contains the following components:
- begins the creation of
http/middleware, migrating request object handling outside the endpoints themselves. -
- also takes over some existing middleware to this new folder, for organizational reasons.
-
- Does transition openai endpoints to use the common model middleware - this should help test coverage
- Finishes up service wiring infrastructure in core/startup
- pkg/concurrency - basic JobResult structure
- Port over TTS Endpoints to TextToSpeechBackendService
- Port over Embedding Endpoint to EmbeddingBackendService
Squashing again, the middleware approach is much more sustainable.
Deploy Preview for localai ready!
| Name | Link |
|---|---|
| Latest commit | 563a416a38620605ea3c7da6082fd134b854dc53 |
| Latest deploy log | https://app.netlify.com/sites/localai/deploys/66725a730eedf80008f34149 |
| Deploy Preview | https://deploy-preview-2474--localai.netlify.app |
| Preview on mobile | Toggle QR Code...Use your smartphone camera to open QR code link. |
To edit notification comments on pull requests, go to your Netlify site configuration.