update ollama 0.3.x support

[przybjul]

''ipex-llm[cpp]==2.5.0b20240527 is consistent with [v0.1.34] of ollama.

Our current version is consistent with [v0.1.39] of ollama.''

Is it possible to update supported ollama version to 0.3.x?

[sgwhat]

hi @przybjul, we can upgrade the version of ipex-llm ollama, and we will notify you immediately after completing the upgrade.

[AlbertXu233]

hi @przybjul, we can upgrade the version of ipex-llm ollama, and we will notify you immediately after completing the upgrade.

I wanna know whether the upgrade is completed or not.

[sgwhat]

Hi @AlbertXu233 , our current version is still consistent with v0.1.39 of ollama. Do you need the newly supported models or other latest features in ollama version 0.3.x?

[rebootcheng]

@sgwhat Some new models are only supported by higher versions of Olama

[sgwhat]

Hi @rebootcheng, we have now supported models available in higher versions of Ollama, including Llama 3.1, Qwen 2, Gemma 2, Phi 3, and others.

[rebootcheng]

Hi @sgwhat The deepseek-coder-v2 model doesn't seem to support it

[reinhardsiegel79]

hi, "tools" seems to be only available in ollama 0.3.x - I would be waiting for that. :)

[AlbertXu233]

Hi @AlbertXu233 , our current version is still consistent with v0.1.39 of ollama. Do you need the newly supported models or other latest features in ollama version 0.3.x?

I need gemma2 2b and batch embedings api in newly ollama version.

[rnwang04]

Hi all, ipex-llm‘s ollama is upgrade to 0.3.6 with ipex-llm[cpp]>=2.2.0b20240827, you may have a try with it 😊