Hyungyo Kim

Is AMX supported for LLM inference?

3

### Describe the issue Hi, I have a quick question regarding the LLM inference on CPUs using this extension. I've been digging into the LLM inference case, and it seems...

[QUESTION] RuntimeError: CUDA error: no kernel image is available for execution on the device

5

Your question: I'm trying to run a GPT pre-training script using examples/pretrain_gpt.sh and the following is the error message I get. ``` Traceback (most recent call last): File "/workspace/megatron/pretrain_gpt.py", line...