BalloutAI
BalloutAI
I am still getting the same problem, my validation during training is high on the listops, but when running test_only option, I am getting very low accuracy!
The problem is that the data is shuffled every time the code is ran, so the tokens are changed when running the test script giving a random accuracy.
Can we use this library for fine-tuning as well or only for inference? If we can, is there documentation on how to use it properly? thanks!
Thank you so much! Any expected timeline for that?
Hey, thanks for the awesome work. I am trying to use it almost as you are using it, but for some reason I am getting 100% accuracy even before training...
Yeah, I have tried printing, and it is getting them correctly ['USER: \nAnswer the following question based on the video by True or False. ASSISTANT: Answer: True']. and it is...
Awesome, thx! I expected that!