mediapipe
mediapipe copied to clipboard
Added iOS refactored LlmInference, LlmTaskRunner and LlmSessionRunner
- Added LlmSessionRunner that manages a C session created by a C engine. Each swift Llm session will be managed by its own LlmSessionRunner.
- Refactored LlmTaskRunner to manage the C Llm Engine. All C methods that require the engine instance are invoked via the LlmTaskRunner
- Added refactored interface for LlmInference.