swift-coreml-transformers

swift-coreml-transformers copied to clipboard

GPT-2 low quality responses

2

I'm trying to develop an iOS app which utilizes your distilgpt2-64-6.mlmodel but getting strange answers to my questions. I configured the model the same as you in attached ViewController: `strategy:...

ljaniszewski00

Add CLIPTokenizer.

1

Here is what I was using for my CLIPTokenizer when I got StableDiffusion working in Swift on a phone. Of course, happy to have eyes on it. Let me know...

MatthewWaller

I freshly cloned the project and I seem to have a problem with the CoreML models. When ever I try to open any of them I get an error: "validation...

0xkon1

Is Text2Text going to be supported?

2

I'm working on a project using T5, and it would be amazing to do everything on device without a need for a server and API. Thanks for all these amazing...

swcrazyfan

Switch back to gpt2 512 model. Fixes gibberish gpt2 output

6

Switches back to the GPT2 512 model that was used for the demo on the README. While slower, the results match the quality of the README's demo. | Current (distilgpt2_64_6)...

djsamseng

Bumps [transformers](https://github.com/huggingface/transformers) from 2.0.0 to 4.30.0. Release notes Sourced from transformers's releases. v4.30.0: 100k, Agents improvements, Safetensors core dependency, Swiftformer, Autoformer, MobileViTv2, timm-as-a-backbone 100k Transformers has just reached 100k stars...

dependabot[bot]

where can I find AutoTokenizer in swift version

sinnuswong

I only get result like this ,and I am using the "distilgpt2_64_6"  and same code could run well on the simulator

realcarlos

CLIPTokenizer

3

Hi y'all, I was looking to convert the[ CLIP Tokenizer found here](https://huggingface.co/transformers/v4.6.0/_modules/transformers/models/clip/tokenization_clip.html). I noticed it seems a lot like the [GPT2Tokenizer.swift](https://github.com/huggingface/swift-coreml-transformers/blob/master/Sources/GPT2Tokenizer.swift). Are there perchance simple adjustments I could make so...

MatthewWaller

Switch to the same weights hosting infra as the main `transformers` repo

3

cc @thomwolf @LysandreJik

julien-c