LMDrive icon indicating copy to clipboard operation
LMDrive copied to clipboard

qformer

Open CoderXuans opened this issue 11 months ago • 0 comments

@deepcs233 你好,我想请问一下if self.has_qformer: print('Loading Q-Former') self.Qformer, self.query_tokens = self.init_Qformer( 4, self.visual_encoder.num_features ) self.Qformer.resize_token_embeddings(len(self.llm_tokenizer)) self.Qformer.cls = None 中的4如果改为别的数字的话,需要自己重新执行Instruction finetuning的训练吗? 我理解的Instruction finetuning是让LLM适应驾驶任务。

CoderXuans avatar Jan 06 '25 09:01 CoderXuans