faiejir
Results
2
comments of
faiejir
> 可以修改一下这个函数, utils.py里面： > > ```python > def auto_configure_device_map(num_gpus: int) -> Dict[str, int]: > # transformer.word_embeddings 占用1层 > # transformer.final_layernorm 和 lm_head 占用1层 > # transformer.layers 占用 28 层 >...
> You need to set LLM_MODEL too. https://litellm.vercel.app/docs/providers/gemini > > Run this to check whether LLM is working properly. > > ```python > import tomllib as toml > from litellm...