Dmitry Nikitko

Serialization of LLM params and local\global LLM assignment

3

I want to understand plans for serialization and deserialization of LLMs from state. If I try to dump_state() of a Predictor or Module I see that conceptually you've been thinking...