Dev-hestabit

@gante Have you thought of any solution and approach to implement assisted generation on transformer-nueronx?

> When i use metaseq-api-local to launch bb3_30B model, i meet the error: hydra.errors.MissingConfigException: In 'config': Could not load 'base_config'. how you reshar the BB3 30B consolidated.pt ?