vinkamath

Output of kubectl describe node Name: stage-worker-gpu-0 Roles: Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/os=linux feature.node.kubernetes.io/cpu-cpuid.ADX=true feature.node.kubernetes.io/cpu-cpuid.AESNI=true feature.node.kubernetes.io/cpu-cpuid.AMXBF16=true feature.node.kubernetes.io/cpu-cpuid.AMXINT8=true feature.node.kubernetes.io/cpu-cpuid.AMXTILE=true feature.node.kubernetes.io/cpu-cpuid.AVX=true feature.node.kubernetes.io/cpu-cpuid.AVX2=true feature.node.kubernetes.io/cpu-cpuid.AVX512BF16=true feature.node.kubernetes.io/cpu-cpuid.AVX512BITALG=true feature.node.kubernetes.io/cpu-cpuid.AVX512BW=true feature.node.kubernetes.io/cpu-cpuid.AVX512CD=true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ=true feature.node.kubernetes.io/cpu-cpuid.AVX512F=true feature.node.kubernetes.io/cpu-cpuid.AVX512FP16=true feature.node.kubernetes.io/cpu-cpuid.AVX512IFMA=true feature.node.kubernetes.io/cpu-cpuid.AVX512VBMI=true feature.node.kubernetes.io/cpu-cpuid.AVX512VBMI2=true feature.node.kubernetes.io/cpu-cpuid.AVX512VL=true feature.node.kubernetes.io/cpu-cpuid.AVX512VNNI=true...

> [@vinkamath](https://github.com/vinkamath) I think there may be a race condition when time slicing is enabled. I would suggest testing with time slicing temporarily disabled. Yes, we're aware that this issue...

Hi @karthikvetrivel, thanks for taking a look at the issue. I've since changed jobs and I won't be able to provide you with additional information to debug this issue. Sorry....