vonpetersenn
vonpetersenn
I have a related question: if the model has 70B parameters, wouldn't we expect the size of the model to be 70*4=280 GB? A Float32 parameter takes up 4 bytes...
thank you very much!
Ok, I found the solution in issue "Improve tag definition #30" The correct way to set tags would habe been `[Dict("key" => "tag1", "value" => "tag1value")]` This should be documented...
@ablaom I have opened a pull request with updated documentation