【PPMix No.6】InternLM-XComposer2.5-7B推理对齐

[Ismoothly]

安装paddleMIX及其依赖 环境准备 conda create -n internlm python=3.11 -y conda activate internlm 下载模型InternLM-XComposer2.5-7B git clone https://github.com/PaddlePaddle/PaddleMIX cd PaddleMIX pip install -e . #ppdiffusers 安装 cd ppdiffusers pip install -e . 安装flash-attention pip install --no-index /home/aistudio/PaddleMIX/ppdiffusers/flash-attention/flash_attn-2.7.3-cp311-cp311-linux_x86_64.whl.whl 模型推理 输入图片 推理结果如图 结果： The image presents a panda bear in its natural habitat, which is characterized by a lush environment with green grass and various plants. The panda's fur is predominantly black with distinctive white patches around its eyes, ears, and shoulders. It stands on all fours, suggesting a moment of rest or observation. The panda's posture is upright, and it appears to be looking downwards, possibly at something of interest on the ground. The blurred background indicates movement, either from the panda itself or from the camera's perspective, adding a dynamic element to the scene. The overall composition of the image captures the essence of the panda's serene yet curious nature within its natural setting. 输入图片 推理结果如图 结果： The image displays a logo and text, both rendered in a monochromatic color scheme. The logo on the left side of the image is composed of abstract shapes that resemble musical notes or symbols, possibly indicating a connection to music or sound. Adjacent to the logo, there's text that reads "Internal M-X Composer 2.5", suggesting that this could be the name of a software or application version 2.5. The font used for the text is bold and sans-serif, which gives it a modern and clean appearance. The overall design implies a technological or creative product, potentially related to music composition or sound design.

[paddle-bot[bot]]

Thanks for your contribution!

[Ismoothly]

InternLM-XComposer2.5-7B 推理对齐 https://github.com/PaddlePaddle/PaddleMIX/issues/1046#issuecomment-2751017056

[lyuwenyu]

请把模型相关代码和参数转换脚步上传一下；另外在examples里新建一个这个模型的目录

[Ismoothly]

已上传参数转换脚本和模型文件

[luotao1]

@Ismoothly 请参考下 Code Review 注意事项

和提交 PR 注意事项

[Ismoothly]

OK，懂了老师，其实就是把一些多余的文件删除了，然后一些文件添加了copyright,然后把图片放到了文件夹里面

[Ismoothly]

已按要求调整

[Ismoothly]

老师，这个PR能合入吗

[lyuwenyu]

老师，这个PR能合入吗

你把这个模型对齐的标准贴到这个PR里吧

[lyuwenyu]

建议改完之后按照readme流程走一遍；保证每一步实现都是可以正确跑通的 并且完备

[Ismoothly]

已按要求修改，模型文件完备，可以运行

[lyuwenyu]

从代码层面这模型应该叫 InternLM-XComposer-2.5 吧；InternLM-XComposer2.5-7B 只是一个模型参数的名字

[Ismoothly]

已把多余的图片删除，修改markdown

[Ismoothly]

已更新路径接受形式

[Ismoothly]

已经修改，上次可能是保存没成功

[luotao1]

hi, @Ismoothly

• 非常感谢你对飞桨的贡献，我们正在运营一个PFCC组织。PFCC是飞桨开源的贡献者俱乐部，只有给飞桨合入过代码的开发者才能加入，俱乐部里每两周会有一次例会（按兴趣参加），也会时不时办线下meetup面基，详情可见 https://github.com/luotao1 主页说明。
• 如果你对PFCC有兴趣，请发送邮件至 [email protected]，我们会邀请你加入~