FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

Published 20 hours ago • verified publisher icon FlagOpen

How to implement LongLLM in NPU device

Open yangjq713 opened this issue 1 year ago • 1 comments

When I create a LongLLM training environment on an NPU device, the installation of the flash-attention dependency is not possible. Are LongLLM training scripts allowed to be utilized on NPU?

yangjq713 avatar Jul 11 '24 07:07 yangjq713

Currently no. You can try use easy_context while using our training data.

namespace-Pt avatar Jul 11 '24 16:07 namespace-Pt

目前没有。您可以在使用我们的训练数据时尝试使用easy_context 。

意思这个链接可以支持NPU微调embedding模型吗？

lwc312123 avatar Dec 04 '24 06:12 lwc312123