llm-foundry
llm-foundry copied to clipboard
mosaicml
LLM training code for Databricks foundation models
The HF export was missing the fc.py file and the associated register, so would result in an error when trying to load the HF exported model. This PR both fixes...
Tests that expected keys for TrainConfig are populated in the logged config
https://github.com/mosaicml/composer/blob/da18d9e4513bc1629849158f5a16108350532adf/composer/trainer/trainer.py#L1042C1-L1043C1 Uses the default eval interval from composer rather than forcing eval_interval to be a required argument
Foundry's train and eval scripts use the `log_config` helper to log the parameter config. However, `log_config` breaks the logger abstraction by directly logging to wandb and/or mlflow. This PR uses...
