crossxxd

does xlora train not support llama2?

4

I've trained xlora with mistral 7b base model, it works fine. However, when switching base model to llama2 7b, it encountered an error. This is my code for training. ```...

cross entropy loss during training with xlora

4

I saw discussions about training in other issues, and I have run train and inference code successfully. Training code is mainly based on SFTTrainer and I think only next-token prediction...

Internvl3 awq quantization model

2

The performance of Internvl3 is excellent. May I ask when a quantized model, such as AWQ, will be released for deployment? Thx!

LLaMA‑Factory sft只能使用amx指令集吗？

3

### Reminder - [x] I have read the above rules and searched the existing issues. ### System Info cpu不支持amx指令集 ### Reproduction ```text 将yaml中KSFTExpertsCPU算子的backend AMXInt8删除以后，报Illegal instruction ``` ### Others _No response_

[RFC]: text-to-image online serving does not support OpenAI-compatible formats

1

### Motivation. To enable standardized integration with other AI applications. ### Proposed Change. Will OpenAI-compatible API formats be supported in the future? ### Feedback Period. _No response_ ### CC List....