cookbook icon indicating copy to clipboard operation
cookbook copied to clipboard

LlamaIndex and Gemini Quickstart

Open lucifertrj opened this issue 1 year ago • 10 comments
trafficstars

This PR contains a notebook: where anyone can get started with LlamaIndex with Gemini as the LLM.

  • Approach-1: Using Image URL as input
  • Approach-2: Using local image

lucifertrj avatar Mar 23 '24 15:03 lucifertrj

Manually confirmed CLA. All good there.

MarkDaoust avatar Mar 29 '24 22:03 MarkDaoust

Manually confirmed CLA. All good there.

Hi @MarkDaoust

Thank you for the confirmation. The review hasn't been reviewed to merge

lucifertrj avatar Apr 05 '24 20:04 lucifertrj

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

Am I doing something wrong here? I get an error: ModuleNotFoundError: No module named 'llama_index.multi_modal_llms.generic_utils' image

TYMichaelChen avatar Apr 08 '24 23:04 TYMichaelChen

We need images that are clearly open-licensed. We can't merge it with these images.

Sure, understood, will modify it

lucifertrj avatar Apr 11 '24 18:04 lucifertrj

Am I doing something wrong here? I get an error: ModuleNotFoundError: No module named 'llama_index.multi_modal_llms.generic_utils' image

LlamaIndex version is changed, we need to install this:

!pip install llama-index-multi-modal-llms-gemini
!pip install llama-index-llms-gemini

I will update the notebook, with free open licensed images and updated modules to run the Quickstart guide

lucifertrj avatar Apr 11 '24 18:04 lucifertrj

@TYMichaelChen

Few changes to note:

  • SimpleDirectoryReader is now imported via llama_index.core
  • from llama_index.multi_modal_llms.generic_utils import load_image_urls is now called via llama_index.core i.e., from llama_index.core.multi_modal_llms.generic_utils import load_image_urls

@MarkDaoust

Used Open Licenses images from Unsplash

lucifertrj avatar Apr 11 '24 19:04 lucifertrj

Please delete the ".DS_Store" file.

For external integrations we're going to start an /examples/integrations directory. Can you create the directory and move this from /quickstarts/ to examples/integrations?

Thanks.

Done

lucifertrj avatar Apr 19 '24 17:04 lucifertrj

Hey @lucifertrj - sorry it's taken a while to get to this. Thanks for the contribution.

Can you give us a bit of context as to what this guide is trying to achieve? Right now it's missing some key introductory text to explain to the user what they are going to learn & do. For my context, and for the guide, can you give it a high level description, like "How to use Llama Index with the Gemini API for multi-turn chat conversations" or whatever task you want cover.

Before we review the content in detail it'd be great to make sure that this doesn't duplicate any existing content, and has some value on its own, so this info will help.

markmcd avatar Aug 15 '24 08:08 markmcd

Hey @markmcd sure. Will document the notebook

lucifertrj avatar Aug 19 '24 16:08 lucifertrj

Marking this pull request as stale since it has been open for 14 days with no activity. This PR will be closed if no further activity occurs.

github-actions[bot] avatar Sep 03 '24 01:09 github-actions[bot]