Scott Wolchok

Results 66 comments of Scott Wolchok

@larryliu0820 your repro script doesn't run for me. perhaps you are using a different torch version than the pinned one? ``` (.venv) swolchok@swolchok-mac ~/src/executorch> python repro.py Traceback (most recent call...

@larryliu0820 sorry I missed a line while pasting. edited.

repros. interestingly, if I comment out the first method.execute call, I get the correct result from the second call.

This is not an operator-specific bug. Also repros with mul/add/div, but not torch.max. I'm probably not the best person to look into this.

LGTM. I think @malfet has a couple unaddressed comments?

1) IIRC, llama.cpp is hiding metal initialization cost behind that startup wall of text. 2) The PyTorch eager MPS backend has a significant overhead on the first run, which you...