llm-foundry icon indicating copy to clipboard operation
llm-foundry copied to clipboard

Make `fc_type` a dict to pass fc kwargs through

Open snarayan21 opened this issue 1 year ago • 0 comments

Some custom FC layers will need custom kwargs. This PR enables that by changing fc_type from str to Union[str, Dict], and converting it to dict thereafter.

Default configs have also been moved to their own file, keeping those defaults easily accessible.

We will likely seek to deprecate fc_type down the line and replace it with fc_config instead.

snarayan21 avatar May 14 '24 03:05 snarayan21