LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

OUTDATED: Service Wiring / Concurrency pt 1

Open dave-gray101 opened this issue 1 year ago • 1 comments

This PR is the start of transitioning our core services to the core/application.go \ core/startup model. In order to keep things reviewable, this PR will have a limited scope - rather than moving everything at once, my goal is to select services that are covered by existing tests for the detection of regressions. Therefore, this PR contains the following components:

  • begins the creation of http/middleware, migrating request object handling outside the endpoints themselves.
    • also takes over some existing middleware to this new folder, for organizational reasons.
    • Does transition openai endpoints to use the common model middleware - this should help test coverage
  • Finishes up service wiring infrastructure in core/startup
  • pkg/concurrency - basic JobResult structure
  • Port over TTS Endpoints to TextToSpeechBackendService
  • Port over Embedding Endpoint to EmbeddingBackendService

Squashing again, the middleware approach is much more sustainable.

dave-gray101 avatar Jun 03 '24 16:06 dave-gray101

Deploy Preview for localai ready!

Name Link
Latest commit 563a416a38620605ea3c7da6082fd134b854dc53
Latest deploy log https://app.netlify.com/sites/localai/deploys/66725a730eedf80008f34149
Deploy Preview https://deploy-preview-2474--localai.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

netlify[bot] avatar Jun 03 '24 16:06 netlify[bot]