Brett Young

Dataset Generation Question

7

First off, thanks for this awesome repo! Helping me a lot with my project!!! Anyway, I'm a bit confused as to how the program is generating the samples that it...

need web

6

The gaping issue I see here is no support for flutter web. Thanks, Brett

### Describe the issue Issue: Instead of checking the folder name, its better to pass the llava and lora as an argument. Otherwise users have no idea why their models...

Validation in training loop?

5

### Question It doesnt look like you validate within the training loop? Just wondering what the reason for this was? Thanks, Brett

this would be helpful. Just friendly suggestion.

does this support tflite select ops? Thanks

Increase Inference Frequency (Android)

5

Hey man, thanks for this awesome plugin. I was looking to increase the number of times per second I run my model. I was able to implement a sliding window...

llama 3 consolidated.00.pth doesnt exist

2

how do i create this from the safetensors dowloaded from the tune download command?

Lora Generate?

1

Does the generation script support using lora adapters after fine tuning?

VRAM Usage / Training Time in comparison to Huggingface

5

Sorry to bother again.. I was able to use batch size of 17 for Llama3 on a single A6000, whereas I could only reach batch size=1 with huggingface (with lora,...