keras-nlp

keras-nlp copied to clipboard

Add sam2

5

https://github.com/facebookresearch/sam2 Also, is it possible to fine-tune [keras-sam](https://keras.io/keras_hub/guides/segment_anything_in_keras_hub/) on custom dataset? or current implementation only for inference?

innat

Add ModernBERT to KerasHub

8

ModernBERT has been released on HuggingFace. Since you can already load models from there into a Keras Backbone, it would be interesting to know, if this works as well. https://huggingface.co/answerdotai/ModernBERT-base

gcuder

Run build if formatting succeeds

5

sampathweb

**Is your feature request related to a problem? Please describe.** I want to contribute the Phi-4 multimodal model. I plan to base the implementation off the [technical report](https://arxiv.org/pdf/2412.08905), so I...

yrahul3910

Convert TF and Numpy ops in whisper_audio_convert.py to Keras Ops

1

This PR is in continuation to the draft [PR ](https://github.com/keras-team/keras-hub/pull/2126). Converted Numpy and TF ops into Keras ops in whisper_audio_converter.py and in whisper_audio_converter_test.py

LakshmiKalaKadali

Added falcon model converter

3

Falcon model converter is missing. Added the same. Fixes [#1988](https://github.com/keras-team/keras-hub/issues/1988)

mehtamansi29

Implement Depth Estimation Pipeline

4

**_Depth estimation is the process of determining the distance of objects from a viewpoint, which is crucial for various applications in computer vision, including autonomous driving, augmented reality, and 3D...

Sohaib-Ahmed21

https://step1x-edit.github.io/

innat

Currently the WhisperBacbone does not support logits output as we can see [here](https://github.com/openai/whisper/blob/517a43ecd132a2089d85f4ebc044728a71d49f6e/whisper/model.py#L245). This would be a building block for other tasks under Whisper Casual LLM. Test output has been...

shanky-kapoor

Running segformer error : ValueError: Attempt to convert a value (<generator object preprocessing at 0x7f59f0168f40>) with an unsupported type (<class 'generator'>) to a Tensor.

11

**Describe the bug** **To Reproduce** **Expected behavior**

Masumekeshavarzi