icrecescu

Hi @Craigacp, thank you for your response! To clarify, the model uses a protobuf file. The input consists of phrases that are transformed into six arrays. The size of these...

Yes, you’re correct — the inputs are typically 20-30 integers long. The model produces two output tensors: A tensor with a constant shape of DenseTFloat32[134][134]. Another tensor with a shape...

Hi @karllessard, thank you for your input! I should clarify that I trimmed the size number when posting — the actual allocation size is closer to 36GB. I’m not aware...

Hi @pluppens, thank you for your suggestions! I’ll give JeMalloc a try. I also suspect a native memory leak, as everything seems fine within the Java heap, as I described...