llm-foundry
llm-foundry copied to clipboard
Make `fc_type` a dict to pass fc kwargs through
Some custom FC layers will need custom kwargs. This PR enables that by changing fc_type from str to Union[str, Dict], and converting it to dict thereafter.
Default configs have also been moved to their own file, keeping those defaults easily accessible.
We will likely seek to deprecate fc_type down the line and replace it with fc_config instead.