Hydra

Hydra copied to clipboard

Dockerfile setup for training and inference

1

Can we get Dockerfile for easy setup for training and inference ? Any help will be appreciated.

gangooteli

Weights are shared across the MLP layers

1

See this https://github.com/linkedin/Liger-Kernel/pull/269 . Confirmed that weights are shared for vicuna 7b ~~Also, for some reason I couldn't find, not all layers have an `res_connection` linear layer~~ Finally, from the...

0seba