pontoon icon indicating copy to clipboard operation
pontoon copied to clipboard

Collect stats on how many users switch to FTL advanced mode

Open flodolo opened this issue 2 years ago • 3 comments

We should try to understand how many people use the advanced editor, and if it's worth being worried about drastic changes.

flodolo avatar Jan 12 '23 14:01 flodolo

Is this request only about clicks on the FTL icon, or submissions from the source editor or both?

We should probably approach collecting UX metrics holistically. The feature has been implemented, but the only data we collect ATM are notification actions.

mathjazz avatar Jan 16 '23 21:01 mathjazz

CC @eemeli

Probably both?

If people switch to FTL but then don't commit, does it mean the FTL mode is not clear enough? I know I'm one who switches frequently to just see the structure, or copy and paste the source, so I might be skewing the results :-(

IIRC, when I talked with Eemeli the concern was around making significant changes (e.g. removing the identifier), and my question was "do we even know if people actually use it?".

flodolo avatar Jan 17 '23 05:01 flodolo

I don't think we can really draw conclusions from FTL editor views because there are so many potential reasons for that, but tracking submitted messages that have been in some way modified within the FTL editor could be useful.

Especially as we're making changes to the rich editor, changes in FTL editor use could be considered as an indicator of the success of those changes (less use indicating changes are improvements, while more use indicating that the changes are detrimental).

eemeli avatar Jan 17 '23 10:01 eemeli