mcfly icon indicating copy to clipboard operation
mcfly copied to clipboard

Accuracy of this tool

Open curusarn opened this issue 4 years ago • 6 comments

Have you measured any accuracy metric on some test data?

I was thinking something like:

  • the average accuracy of the Nth suggested result
  • the average number of characters saved using the Nth result

curusarn avatar Mar 06 '20 14:03 curusarn

I haven't done any rigorous study. I do use it every day, though, and continue to find it useful :)

cantino avatar Mar 06 '20 21:03 cantino

If you want to study it, that'd be interesting!

cantino avatar Mar 06 '20 21:03 cantino

I just wanted to provide some feedback - I have used this for about a month after (I think) seeing it on Reddit. I've actually found it rather frustrating generally as the top result is almost never the result that I want... I think this is because I generally expect it to weight recent commands more heavily, and it feels like maybe mcfly actually does the opposite (which is possibly desired for certain use cases, but generally not mine).

On a slightly separate but related note, (for me, at least) the results don't wrap onto newlines if they're too long - and the commands that I'm searching often are long - which means that I can't even pick the correct result. Maybe I should open this as a separate issue.

I've had to uninstall mcfly for now, which makes me sad, as I love the idea... Good work on it - but for now it's not for me. Might try to dig into the source later and try to understand if I can suggest any concrete improvements if/when I have some time.

samuelhwilliams avatar May 19 '20 10:05 samuelhwilliams

Thanks for the feedback @samuelhwilliams. I've been meaning to re-run the training algorithm, when I get around to that, maybe it'll help. I should also expose the parameters so that users can tweak them and submit values that work well for them.

Please do submit a second issue, ideally with examples, for your wrapping issue.

cantino avatar May 24 '20 23:05 cantino

I also feel the same here. I really like the usability and the look and feel of the tool. My approach would be to disable the "smart" search by folder.

I would like you to show me the recent commands and folders that I don't work on so much I would leave the tool's default behaviour in the folders that I'm constantly working on.

mrcosta avatar May 03 '21 08:05 mrcosta

I liked the idea of this tool too, but it turns out it was usually wrong for me too, and I simply wanted the most recent result. It would be better if I could change the sorting ala https://github.com/cantino/mcfly#results-sorting on the fly via the interface. Going to uninstall for now.

mikob avatar Dec 12 '21 16:12 mikob