Scott Wolchok
Scott Wolchok
@larryliu0820 your repro script doesn't run for me. perhaps you are using a different torch version than the pinned one? ``` (.venv) swolchok@swolchok-mac ~/src/executorch> python repro.py Traceback (most recent call...
@larryliu0820 sorry I missed a line while pasting. edited.
repros. interestingly, if I comment out the first method.execute call, I get the correct result from the second call.
This is not an operator-specific bug. Also repros with mul/add/div, but not torch.max. I'm probably not the best person to look into this.
LGTM. I think @malfet has a couple unaddressed comments?
1) IIRC, llama.cpp is hiding metal initialization cost behind that startup wall of text. 2) The PyTorch eager MPS backend has a significant overhead on the first run, which you...