Butterfly icon indicating copy to clipboard operation
Butterfly copied to clipboard

[Feature request]: Use stylus to insert text

Open gieselbusch opened this issue 1 year ago • 8 comments
trafficstars

Is your feature request related to a problem? Please describe

No response

Describe your feature request!

On the Google Pixel Tablet you can use a pen or stylus to insert text in a pretty easy way. The recognition of the handwriting works great. This may be true for other tablets too. It would be really nice to use feature inside butterfly. Unfortunately the pen could just be used to place a label but not to write text.

Additional context

No response

Code of Conduct

  • [X] I agree to follow this project's Code of Conduct

gieselbusch avatar Apr 26 '24 09:04 gieselbusch

Hi, How do you mean recognition? Is this a native feature in the keyboard? Butterfly opens the native keyboard if you use the label tool and click on the position where you want to add it

CodeDoctorDE avatar Apr 26 '24 09:04 CodeDoctorDE

Hi, I don't know how this exactly works. It might be, that the handwriting recognition is handled like a keyboard by the system. In most apps I can write anywhere on the screen and the app will take this as an input at the position of the cursor. It's shortly shown in this video (yt). But that's not the exact feature, since he has to write in a specific area.

gieselbusch avatar Apr 26 '24 09:04 gieselbusch

I think that's what you mean

https://github.com/LinwoodDev/Butterfly/assets/47901429/9fac05d1-f2a6-4bdc-a93f-5ece51843863

MrGumpIT avatar May 13 '24 20:05 MrGumpIT

Yes, exactly. But in most apps you even don't have to write in the URL field, which makes the usage a lot more comfortably.

gieselbusch avatar May 22 '24 10:05 gieselbusch

I believe gboard calls it write in text fields and it has something to do with:

Screenshot_20240803-225113_Settings

Also there's another way of implementing this, where you keep handwritten text, but you save it's recognized form somewhere, so it becomes indexable. (but that's probably a different is issue)

and with a full (I don't know flutter, so I don't know if it's relevant) disclaimer out at the way, this package looks interesting: https://pub.dev/packages/google_mlkit_digital_ink_recognition

pacjo avatar Aug 03 '24 21:08 pacjo

Hmm, the thing is: This is not native. There you need to download an ai model to use it. I don't know if it is worth the time. If gboard can do it, this wouold solve the issue here i guess?

CodeDoctorDE avatar Aug 03 '24 21:08 CodeDoctorDE

This is not native.

yeah...

There you need to download an ai model to use it.

really? I must have missed that part. That's probably a licensing issue too?

If gboard can do it, this wouold solve the issue here i guess?

Possibly, but I think that's for the author to decide, @gieselbusch?

In case it's closed, should I open another issue for the indexing suggestion?

pacjo avatar Aug 03 '24 21:08 pacjo

Many thanks for these suggestions and thoughts. It would be enough for me if the solution would work via Gboard (write in text fields). But unfortunately this is not the case.

gieselbusch avatar Aug 05 '24 14:08 gieselbusch