Fermata icon indicating copy to clipboard operation
Fermata copied to clipboard

[Feature Request] Mouse navigation speed & Voice Input to Search or enter

Open discoinferno1 opened this issue 2 years ago • 19 comments

Hi Andrey,

Thank you very much for the good work and contribution.

May I kindly request for faster mouse pointer movement and because right now with Mazda Infotainment Display we have to do multiple pushes to the left right or up down with the rotary dial as it's not a touchscreen. This results in maybe 20-30 nudged on the dial to reach one part of the desired screen location. Secondly, the voice input is an excellent and super accurate feature but could there be a shortcut to launch this ? it would be super helpful for navigation with a non touch screen model. Besides that, it would be effective as well if there is a shortcut button to enter or search after voice input for search..Once again thank you very much for your efforts.

discoinferno1 avatar Sep 22 '23 12:09 discoinferno1

Try this version - https://drive.google.com/file/d/1lYr5T7Hu5DfCvfV3wepajrvRsmjw57d5/view?usp=drive_link . It has some enhancements for the cursor navigation.

For the voice input you can bind a steering wheel button. You can find the key bindings in the ap settings.

AndreyPavlenko avatar Sep 22 '23 12:09 AndreyPavlenko

I'll add to this. Is it possible to move the cursor by holding the control knob instead of nudging every time?

What about touchpad support (e.g. Audi A3 8V)?

FPSUsername avatar Sep 25 '23 07:09 FPSUsername

I'll add to this. Is it possible to move the cursor by holding the control knob instead of nudging every time?

https://drive.google.com/file/d/1lYr5T7Hu5DfCvfV3wepajrvRsmjw57d5/view?usp=drive_link

What about touchpad support (e.g. Audi A3 8V)?

Could you send me the log? https://github.com/AndreyPavlenko/Fermata/issues/287#issuecomment-1722471651

AndreyPavlenko avatar Sep 25 '23 12:09 AndreyPavlenko

Hey Andrey,

Sorry for the late reply, I completely forgot about it. Here's the log. Fermata.log

The issue I'm having with the browser is that the cursor is often invisible, especially when the "touch" operation is happening. There's no blue bounding box around the selected item (like it is when you select items inside AA). This makes it pretty much impossible to use.

FPSUsername avatar Oct 03 '23 18:10 FPSUsername

Hey Andrey,

Sorry for the late reply, I completely forgot about it. Here's the log. Fermata.log

The issue I'm having with the browser is that the cursor is often invisible, especially when the "touch" operation is happening. There's no blue bounding box around the selected item (like it is when you select items inside AA). This makes it pretty much impossible to use.

Thanks. Unfortunately, I don't see any events from the touchpad in the log. Try this version https://drive.google.com/file/d/1lYr5T7Hu5DfCvfV3wepajrvRsmjw57d5/view?usp=drive_link . If the cursor does not appear, press the back button.

AndreyPavlenko avatar Oct 03 '23 18:10 AndreyPavlenko

I'm already using that version (you linked it three times by now). The UI is definitely a great improvement over the previous version. I'll try to get a new log tomorrow using your advice.

FPSUsername avatar Oct 03 '23 18:10 FPSUsername

I'm already using that version (you linked it three times by now).

I've updated it today with a few fixes.

AndreyPavlenko avatar Oct 03 '23 18:10 AndreyPavlenko

Fermata.log

Here's a new log. The cursor does keep moving when you hold the joystick. The issue is that the cursor hides behind any popup. Popup from the menu (where the browser launch is), popup from google's afwul cookiewall and the URL bar (scrolling in the "selection" mode doesn't select the URL bar.

FPSUsername avatar Oct 04 '23 15:10 FPSUsername

The issue is that the cursor hides behind any popup.

With popup menu it's a bit more complicated, because it's drawn above the app view.

URL bar (scrolling in the "selection" mode doesn't select the URL bar.

Sorry, didn't get this.

AndreyPavlenko avatar Oct 04 '23 19:10 AndreyPavlenko

The spot where you'd put in the URL (to browse any website) also renders on top of the cursor.

FPSUsername avatar Oct 04 '23 19:10 FPSUsername

Try pressing the back button when a popup menu appears and the cursor disappears.

AndreyPavlenko avatar Oct 05 '23 19:10 AndreyPavlenko

In that case, the selection mode would be active, but it's impossible to navigate through browser popups when there's no active marking shown. The only proper way would be to be able to render the cursor on top of popups.

By the way, is it possible to implement touchpad support? My rotary dial has a touchpad that could be used as a cursor as well.

FPSUsername avatar Oct 05 '23 19:10 FPSUsername

In that case, the selection mode would be active, but it's impossible to navigate through browser popups when there's no active marking shown.

Could you share a URL of a web page with such a popup.

By the way, is it possible to implement touchpad support?

I didn't find a way how to receive touchpad events.

AndreyPavlenko avatar Oct 05 '23 19:10 AndreyPavlenko

Could you share a URL of a web page with such a popup.

The home page, Google.

FPSUsername avatar Oct 05 '23 20:10 FPSUsername

The home page, Google.

When you click on the google search bar, the cursor disappears to allow typing. To make it appear again, press the back button. The cursor should be on top of the popup.

AndreyPavlenko avatar Oct 06 '23 07:10 AndreyPavlenko

@AndreyPavlenko , Are you still working on something to have a pointer or better selection method for non-touch screen displays? I have a Mazda CX-9 which of course has the knob and there's no way to see what you are selection once you're out of the menu.

Maybe there's a way to use the parse the knob turn event as a tab, then it could just highlight the selected link?

Welp, I'm on 1.9.3 and see the update to 1.9.5 and will check that out later!

JVKeller avatar Nov 15 '23 15:11 JVKeller

There were some fixes in 1.9.5, but still there are some issues with pop-up.

AndreyPavlenko avatar Nov 15 '23 15:11 AndreyPavlenko

Hi Andrey,

Thank you very much for the good work and contribution.

May I kindly request for faster mouse pointer movement and because right now with Mazda Infotainment Display we have to do multiple pushes to the left right or up down with the rotary dial as it's not a touchscreen. This results in maybe 20-30 nudged on the dial to reach one part of the desired screen location. Secondly, the voice input is an excellent and super accurate feature but could there be a shortcut to launch this ? it would be super helpful for navigation with a non touch screen model. Besides that, it would be effective as well if there is a shortcut button to enter or search after voice input for search..Once again thank you very much for your efforts.

Fermata Auto should be working now on your MZD unit - https://www.youtube.com/watch?v=X6qklvaVofw

fwon2638 avatar Jan 12 '24 05:01 fwon2638

Great job Andrey! I will test it out later today and report back.

On Fri, Jan 12, 2024, 12:32 AM fwon2638 @.***> wrote:

Hi Andrey,

Thank you very much for the good work and contribution.

May I kindly request for faster mouse pointer movement and because right now with Mazda Infotainment Display we have to do multiple pushes to the left right or up down with the rotary dial as it's not a touchscreen. This results in maybe 20-30 nudged on the dial to reach one part of the desired screen location. Secondly, the voice input is an excellent and super accurate feature but could there be a shortcut to launch this ? it would be super helpful for navigation with a non touch screen model. Besides that, it would be effective as well if there is a shortcut button to enter or search after voice input for search..Once again thank you very much for your efforts.

Fermata Auto should be working now on your MZD unit - https://www.youtube.com/watch?v=X6qklvaVofw

— Reply to this email directly, view it on GitHub https://github.com/AndreyPavlenko/Fermata/issues/297#issuecomment-1888461491, or unsubscribe https://github.com/notifications/unsubscribe-auth/AG6GTYXKQSTYUULWZRLUBEDYODDGPAVCNFSM6AAAAAA5DBFWBOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBYGQ3DCNBZGE . You are receiving this because you commented.Message ID: @.***>

JVKeller avatar Jan 12 '24 13:01 JVKeller