Niranjan Yadla

@generic-matrix please see the sample [notebook](https://colab.research.google.com/github/usefulsensors/openai-whisper/blob/main/notebooks/generate_tflite_from_whisper.ipynb) converting from TFWhisperForConditionalGeneration to tflite

> Hey @nyadla-sys - cool to see that you're using the TF model for inference! Could I respectfully ask that we try and keep the GitHub issue thread relevant to...

@gante is it possible to add representative_dataset and generate tflite(int8) model. converter.representative_dataset = representative_dataset https://colab.research.google.com/github/usefulsensors/openai-whisper/blob/main/tinynn_pytorch_to_tflite_int8.ipynb

> Hi @nyadla-sys wave > > That is a great question! The problem here is that generation is much more than a forward pass of the model. Fortunately, our generation...

@gante Is it feasible to include Conv2d and avoid getting FlexConv2D as part of the model? TFLite interpreter needs to link Flex delegate in order to run the model since...

@gante When I run generated tflite file with the minimal example from tensorflow/lite/example and it fails with below error msg Execution plan as the list of 568 nodes invoked in-order:...

@gante I modified generation code as below and it works fine @tf.function( # shouldn't need static batch size, but throws exception without it (needs to be fixed) input_signature=[ tf.TensorSpec((1, 80,...

@gante I found that my 30-second audio has more generated ids than the 21 produced by the whisper TFlite model. Is there anything from the tflite model that I am...

increased the max_tokens to 200 and now I could generate whole audio text

@gante now I modified the [colab](https://colab.research.google.com/github/usefulsensors/openai-whisper/blob/main/notebooks/tflite_from_huggingface_whisper.ipynb) notebook to generate more tokens as per below line from HF colab predicted_ids = model.generate(inputs, max_length=480_000) Referred this snippet from HF colab https://colab.research.google.com/drive/191WGH59ZZ-xyu8d6GWbuqZHa_MQJmQpA?usp=sharing#scrollTo=yENhy_7Qq5nU