mmf icon indicating copy to clipboard operation
mmf copied to clipboard

[feat] MMFT MLP head output key; mix model losses and MMFLosses

Open apsdehal opened this issue 3 years ago • 3 comments

This will allow doing multitasking on single batch easily through different heads with different output_key per task

Mixing allows usage of heads that returns losses directly with heads that don't and rely on MMFLoss

Test Plan: Tests have been added

apsdehal avatar May 04 '21 17:05 apsdehal

@apsdehal has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

facebook-github-bot avatar May 04 '21 17:05 facebook-github-bot

@apsdehal has updated the pull request. You must reimport the pull request before landing.

facebook-github-bot avatar May 04 '21 21:05 facebook-github-bot

@apsdehal has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

facebook-github-bot avatar May 04 '21 21:05 facebook-github-bot