aitextgen
aitextgen copied to clipboard
Allow specifying optimizers and schedulers for training
This will be necessary for more memory-efficient training and potential optimizations (e.g. Cosine scheduling vs. linear scheduling)