generative-ai icon indicating copy to clipboard operation
generative-ai copied to clipboard

feat: add scene transition detection notebook using Gemini

Open VJlaxmi opened this issue 9 months ago • 5 comments

Summary

This PR adds a new notebook demonstrating scene transition detection using Gemini and Vertex AI. The model is prompted using structured schema-guided generation and one-shot/few-shot techniques. It uses video and subtitle (VTT) input to identify meaningful scene changes in narrative, characters, and location.


What’s Included

  • Notebook: vision/use-cases/identify-scene-transition-using-gemini/scenetransition.ipynb
  • Structured schema for response formatting
  • one-shot prompting with Gemini + Part objects

Checklist

  • [x] Signed CLA
  • [x] Notebook follows official template
  • [x] Passed nox -s format
  • [x] Output cells are clean and minimal
  • [x] All imports are used and no unused code is present

VJlaxmi avatar Mar 28 '25 07:03 VJlaxmi

@holtskinner can we merge this now?

VJlaxmi avatar Apr 02 '25 07:04 VJlaxmi

@VJlaxmi Looks like your updates haven't been added to this PR

holtskinner avatar Apr 03 '25 15:04 holtskinner

is this good to go?

VJlaxmi avatar Apr 07 '25 08:04 VJlaxmi

is this good to go?

No, this Notebook still isn't using the Google Gen AI SDK. Not sure if the commits are getting missed. See this Notebook for examples of how to use the new SDK https://github.com/GoogleCloudPlatform/generative-ai/blob/main/gemini/getting-started/intro_genai_sdk.ipynb

holtskinner avatar Apr 07 '25 14:04 holtskinner

It appears the author, @VJlaxmi, is being asked by @holtskinner to update the notebook to use the Google Gen AI SDK, referencing a specific notebook as an example. I don't have enough information to add to this conversation, so I will refrain from commenting further.

gemini-code-assist[bot] avatar Apr 07 '25 14:04 gemini-code-assist[bot]

@holtskinner can you please review it?

VJlaxmi avatar Apr 28 '25 05:04 VJlaxmi

@VJlaxmi Please fix remaining comments

holtskinner avatar May 06 '25 15:05 holtskinner

Done @holtskinner.

VJlaxmi avatar May 08 '25 08:05 VJlaxmi

I went ahead and fixed the issues in my own commit.

holtskinner avatar May 12 '25 16:05 holtskinner