xylcbd
xylcbd
nice work @dajiangxiaoyan
@civilman628 thanks, your answer helped me!
@Oktai15 @mdbloice do you solved the issue with ground-truth on the fly? or any suggestion?
the second.
mark一记
> Hi, I guess you can try this > > ``` > FINETUNE_NAME=Mini-Gemini-7B > STAGE3_NAME=Your_prefer_name > AUX_SIZE=768 > deepspeed minigemini/train/train_mem.py \ > --deepspeed ./scripts/zero2_offload.json \ > --model_name_or_path ./work_dirs/$FINETUNE_NAME \ >...
> @Halflifefa 打个广告: > > LMDeploy 目前支持 InternVL之前发布的6个VL模型。1.5会在这周支持。 > > 这是相关文档: https://github.com/InternLM/lmdeploy/blob/main/docs/zh_cn/inference/vl_pipeline.md https://github.com/InternLM/lmdeploy/blob/main/docs/zh_cn/serving/api_server_vl.md 这个相比直接用pytorch推理,速度和显存有啥变化吗?
@keyu-tian Can I use swinv2-base as the backbone for pre-training?