Christopher Hanes
Results
2
comments of
Christopher Hanes
Just to add a bit more information, I spent time adding debug output to the New Relic middleware and confirmed the `complete` function (https://github.com/binaryseed/new_relic_absinthe/blob/master/lib/new_relic/absinthe/middleware.ex#L42) is getting called. I printed out...
I had this issue running Llama3 8B-Instruct on a machine with 16gb RAM, 24GB VRAM. I changed the instance to one with 32gb RAM, 24 GB VRAM and it worked.