tflite-android-transformers

tflite-android-transformers copied to clipboard

when I set this:  but when I check the model.I got this:  and I also test the true model,it's right  how to solve this problem?

songdlut

model generated by model_generation but not able to invoke.

4

I tried to convert tensorflow model to tflite using `model_generation/distilbert.py`. I was able to convert and save the model without error, but could not allocate_tensor with python API and invoke...

o20021106

When I was clone & run your GPT2 example code, there are some runtime error when try to load model. How can I run this code? - tried tflite version...

jason9693

ghost

unrecognized FlexErf node in downloaded tflite model

2

Hi, I'd like to download the default distilbert model with the [link](https://s3.amazonaws.com/models.huggingface.co/bert/distilbert-base-uncased-distilled-squad-384.tflite) in [download.gradle](https://github.com/huggingface/tflite-android-transformers/blob/master/bert/download.gradle). It seems the model contains a FlexErf node, which causes failure when I try to run...

devandong

Has the demo gif for text generation been sped up?

1

Hi, I cannot achieve the speed demonstrated in the gif: https://github.com/huggingface/tflite-android-transformers/tree/master/gpt2 It takes about 7 seconds to generate a single word on my build. I am even using gpuDelegate to...

farazk86

@Pierrci I used the DistilBERT model with the SST-2 dataset for text classification. I then converted the trained model to TensorFlow Lite using float16 quantization. Here's my [notebook](https://github.com/sayakpaul/BERT-for-Mobile/blob/master/DistilBERT_SST-2_TPU.ipynb). Then when...

sayakpaul

Hi, I was wondering how to run the tflite models on Linux with arm architectures (Raspberry Pi) instead of andriod/ios? Is there a transformers library for such systems? Thanks, Mohamed.

Mo-Abdelgawad

New method to set shape of model inputs

1

For tensorflow>=2.2.0, the model._set_inputs failed in https://github.com/huggingface/tflite-android-transformers/blob/dcd6da1bfb28e3cd6bc83b58a112cdcd3d6cc2fe/models_generation/gpt2.py#L7 , and the model.inputs and model.outpus are all None. The following error will happen when running in Android: ```java.lang.IllegalStateException: Internal error: Unexpected failure...

fuzhenxin

Can anyone give me the Android app apk file of distill GPT 2

1

danish9129