llm-foundry
llm-foundry copied to clipboard
Unify export script arguments after next version release
🚀 Feature Request
unify export script arguments after next version of LLM-Foundry to improve UX, but not immediately so we don't break people's workflows.
Motivation
inference scripts have nearly identical arguments with different naming conventions (e.g)
convert_hf_mpt_to_ft.py
--name_or_dir NAME_OR_DIR, -i NAME_OR_DIR
HF hub Model name (e.g., mosaicml/mpt-7b) or local dir path to load checkpoint from
and convert_hf_to_onnx.py
--pretrained_model_name_or_path PRETRAINED_MODEL_NAME_OR_PATH
[Optional] Implementation
check for aligned arguments and pick a naming convention.