moondream Could you compare with MoE-LLaVA-1.6B×4-Top2? It seems more better?

Could you compare with MoE-LLaVA-1.6B×4-Top2? It seems more better?

Open llziss4ai opened this issue 1 year ago • 0 comments

Model Activated Param Resolution VQAv2 GQA VizWiz T-VQA

MoE-LLaVA-1.6B×4-Top2 2.0B 336 76.7 60.3 36.2 50.1

moondream 1.6B 384 74.3 56.3 30.3 39.8

Model	Activated Param	Resolution	VQAv2	GQA	VizWiz	T-VQA
MoE-LLaVA-1.6B×4-Top2	2.0B	336	76.7	60.3	36.2	50.1
moondream	1.6B	384	74.3	56.3	30.3	39.8

I just found its results from https://github.com/PKU-YuanGroup/MoE-LLaVA/tree/main?tab=readme-ov-file#-model-zoo

Feb 01 '24 12:02 llziss4ai