samipdahalr

Timing generator function

1

Is there any way to time how long it takes to execute a generator function in python with `Histogram.time`? Right now, it only seems to measure the time to get...

Memory usage not going up with model instances

1

Hi, I am using this backend for inference with GPT-J model ([Codegen](https://github.com/salesforce/CodeGen) converted to GPT-J checkpoint to be precise). And I'm trying to load more than one model instances to...