mediapipe icon indicating copy to clipboard operation
mediapipe copied to clipboard

Added iOS refactored LlmInference, LlmTaskRunner and LlmSessionRunner

Open priankakariatyml opened this issue 6 months ago • 1 comments

  1. Added LlmSessionRunner that manages a C session created by a C engine. Each swift Llm session will be managed by its own LlmSessionRunner.
  2. Refactored LlmTaskRunner to manage the C Llm Engine. All C methods that require the engine instance are invoked via the LlmTaskRunner
  3. Added refactored interface for LlmInference.

priankakariatyml avatar Aug 12 '24 15:08 priankakariatyml