jwohlwend
Small Sample Dataset with Format Guidance for Fine-Tuning
Amazing work! I truly appreciate the initiative and effort. I was wondering if you could provide a very small, illustrative dataset along with format guidance for fine-tuning purposes --just a minimal, clear example to clarify the structure and requirements for fine-tuning. Thanks a lot!
Hi, we will soon publish code to process structures and train/finetune the model (most likely before the end of next week)
Hi @holgerroth we recently published the code and instructions to process structures and train the model. Apologies for the delay!
So these instructions would be great for training, but do you have any insight into fine-tuning? We have a small dataset in which we want to fine-tune by keeping at least part of the model frozen instead of a full retrain. We will eventually figure it out, but any help here would be great. Thanks.
Hi @jadolfbr we are currently working through a couple of such fine-tuning pilot projects, that we will use to draw clear guidance on how to do fine-tuning best. Right now I'm happy to chat through ideas but we are not yet able to confidently publish a clear guidance!
Beautiful! Thank you!!
Once we start doing some fine tuning in Feb, if you are still at it, we will also share what we learn. Thanks for all your hard work Gabrielle!
On Wed, Jan 15, 2025 at 12:29 PM Gabriele Corso @.***> wrote:
Hi @jadolfbr https://github.com/jadolfbr we are currently working through a couple of such fine-tuning pilot projects, that we will use to draw clear guidance on how to do fine-tuning best. Right now I'm happy to chat through ideas but we are not yet able to confidently publish a clear guidance!
— Reply to this email directly, view it on GitHub https://github.com/jwohlwend/boltz/issues/59#issuecomment-2593541444, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAZDHRHXBNE6I7XW7RF5GLL2K2LINAVCNFSM6AAAAABSOW3PKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKOJTGU2DCNBUGQ . You are receiving this because you were mentioned.Message ID: @.***>
