litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard

1.8B H2O model

Open rasbt opened this issue 1 year ago • 3 comments

A nice new 1.8B base model from H2O which would run on a single GPU. Looks like Llama 2 with Mistral tokenizer and might be an easy add: https://huggingface.co/h2oai/h2o-danube2-1.8b-base

rasbt avatar Apr 05 '24 20:04 rasbt

Hi @rasbt, Can I please work on this?

Dev-Khant avatar Apr 12 '24 17:04 Dev-Khant

Oh sure, that would be nice!

rasbt avatar Apr 12 '24 18:04 rasbt

Hi @rasbt, Could you please review this https://github.com/Lightning-AI/litgpt/pull/1282.

Dev-Khant avatar Apr 18 '24 09:04 Dev-Khant