Runhui Huang
Runhui Huang

1. ps_strategy 2. add ps_strategy to jax example 3. add Typing in ps_strategy.py, allreduce_strategy.py and base_strategy.py 4. strategy and jax operator save/load states
Feeding different boxes will always get the same outputs.
I found that the 'self.image_newline' in LlavaMetaModel was not tuned during the pre-training stage. Have you tried enabling this parameter during pre-training?