Travis Zhang

https://www.linkedin.com/in/jinhe-travis-zhang-311674295/ [email protected]

University of Waterloo Ontario, Canada Backend engineer at Confluent, contributer to Kafka Streams. University of Waterloo Alumni.

Results 3 comments of


                                            Travis Zhang

model_config = model.config.to_dict() - AttributeError: 'dict' object has no attribute 'to_dict'

I found this error on my macOS

Free memory when already run the prompt

Hi, I've met the same problem. The job is done but the memory is still in use, and eventually cause OOM and CUDA out of memory.

Free memory when already run the prompt

I've tried the unload_all_models() function, but it can only free part of the memory.