marcov-dart

Pretty sure this is unrelated to this package. It is odd though, because it I have it working. I have cupertino_icons and uses-material-design: true, svg assets, png assets and fonts...

I want to display an overlay with the 4 corners highlighted like the commented out one in the example (mobile_scanner_overlay.dart). I uncommented that example and made it more or less...

> This is a known issue and I have already been working on it. In short, we need to lock the aspect ratio in order to match the overlay with...

I somewhat figured out what is going on here. For android in MobileScanner.kt there is on line 239 val analysisSize = analysis.resolutionInfo?.resolution ?: Size(0, 0). For me that gives me...

Sounds interesting. I should read the paper first, but just going of the text you provided I am unsure how you are relating it to bpe. They are going from...

Well, I did look at the cl100k_base tokens. And sure it has lots of words in them. And lots of wordpieces that make sense to me. But also just as...

I was thinking a scheme where the tokeniser doesn't just give a sequence of tokens but also a set of modifiers to the tokens. The integer we would use as...

Yes, I do not expect it to be easy. But then again the current approach shows us that our encoding doesn't have to be perfect. A hybrid approach maybe. Partly...

@NiceGuySaysHi Thank you for the suggestion. It was honestly helpful. I think your suggestion of taking a modern bpe is good. If the tokeniser gets trained on the entire training...

@zouharvi You're fine. I am super interested to learn anything relating to encoding of text and downstream performance. I haven't properly read your paper yet, but I will. The biggest...