Maxim Afanasyev comments

Results 5 comments of


                                            Maxim Afanasyev

debugging custom models

> Is there an easy change to instead more lightly fine tune an existing model on my dataset? I've managed to fine-tune an existing model with these steps: 1. Download...

Treat digits as a continuous word

Hello! Sorry, for a late reply, but I'm currently busy at work. I will look into this issue when I'll have some time :)

1.10.2 update, now it compiles!

@hsyyid updated dependency in build.gradle.

The kotlinx.io.core.String(ByteArray, Int, Int, Charset) function ignores the length and offset arguments on JS

Looks like an array returned by the [`TypedArray#subarray(...)`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/TypedArray/subarray) method uses **the same** buffer as the original array: `The subarray() method returns a new TypedArray on the same ArrayBuffer store and...

DummyTextInputGenerator doesn't take into account type_vocab_size model config parameter

Hello! After some research, I figured out that the problem is related to Optimum's dummy input generators. The DummyTextInputGenerator [always use 2 as a max value](https://github.com/huggingface/optimum/blob/main/optimum/utils/input_generators.py#L430) for token type IDs,...