composer
composer copied to clipboard
Add analytics logging to `MosaicMLLogger`
trafficstars
Add log_analytics function to MosaicMLLogger
This adds a log_analytics function to the MosaicMLLogger, which records these metrics about composer runs on the Mosaic platform:
fsdp_configsharding_strategystate_dict_typeactivation_checkpointingforward_prefetchbackward_prefetchmixed_precisiondevice_mesh
autoresumealgorithmscloud_providerscloud_provider_datacloud_provider_checkpoints
save_intervalloggersprecisionoptimizer
By logging these fields from the MosaicMLLogger into a run's metadata, we can then parse the metadata in SQL and add these metrics into UC. This will enable anyone on the genai team to create dashboards / queries for analytical purposes and view the patterns in these metrics across runs on the platform. (see the genai_runs table for more info)