mediapipe
mediapipe copied to clipboard
Xcode: Getting Failed to initialize LlmInference session -> Failed to map, error: Cannot allocate memory
Working well in Xcode simulator but getting following error for Device:
Failed to initialize LlmInference session: ; RET_CHECK failure (external/odml/odml/infra/genai/inference/ml_drift/llm/llm_metal_runner.mm:87) llm_runner->model_->Init(llm_config, num_output_heads, std::move(tensor_loader), create_info, sampler_params, &llm_runner->metal_device_) returned INTERNAL: ; RET_CHECK failure (external/odml/odml/infra/genai/inference/utils/llm_utils/memory_mapped_file_posix.cc:86) (data)!=(((void *)-1))Failed to map, error: Cannot allocate memory
Device is having sufficient memory and the model size is 1.35 GB.