[Good First Issue]: Verify gemma-7b-it with GenAI text_generation

[p-wysocki]

Context

This task regards enabling tests for gemma-7b-it. You can find more details under openvino_notebooks LLM chatbot README.md.

Please ask general questions in the main issue at https://github.com/openvinotoolkit/openvino.genai/issues/259

What needs to be done?

Described in the main Discussion issue at: https://github.com/openvinotoolkit/openvino.genai/issues/259

Example Pull Requests

Described in the main Discussion issue at: https://github.com/openvinotoolkit/openvino.genai/issues/259

Resources

• Contribution guide - start here!
• Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers

Contact points

Described in the main Discussion issue at: https://github.com/openvinotoolkit/openvino.genai/issues/259

Ticket

No response

[VinayN18]

.take

[p-wysocki]

Hello @VinayN18, the ticket will be manually assigned to you shortly - the take feature hasn't been introduced to GenAI repo yet, but it will be today. :)

Thanks for taking a look at the issue!

[p-wysocki]

Hello @VinayN18, is there anything we could help you with?

[VinayN18]

Hello @p-wysocki I am working on it, I will let you know if I face any difficulties.

[VinayN18]

Hello @VinayN18, is there anything we could help you with?

Hello @p-wysocki I am facing memory issue when converting the gemma-7b-it model. I tried running the model in my local PC using Nvidia GeForce RTX 3050 Ti GPU and Google colab (free version) but due to the memory limit I was not able to convert it. I will try some other platforms and keep you posted. Could you also suggest any other methods to overcome this issue

[p-wysocki]

cc @pavel-esir

[Wovchena]

@VinayN18 any updates here? You don't need a dedicated GPU memory. Only RAM is needed to run it on CPU.

[Wovchena]

I unassigned the issue. Feel free to take it again if you are still working on it.

[ali-john]

Hello, I would like to work on this issue

[haroon0x]

@ali-john Are you still working on this issue? if not I would like to work on this.

[haroon0x]

.take

[github-actions[bot]]

Thanks for being interested in this issue. It looks like this ticket is already assigned to a contributor. Please communicate with the assigned contributor to confirm the status of the issue.

[ali-john]

@sky0walker99 you can work on it

[Huanli-Gong]

.take

[github-actions[bot]]

Thank you for looking into this issue! Please let us know if you have any questions or require any help.

[Huanli-Gong]

@ilya-lavrenov This issue is closed. Do I still need to work on it?