【bug】KeyError: 'factor' when use Triplex

[ForgetThatNight]

command is ` python -m fastchat.serve.model_worker --model-names Triplex --model-path /data/cache/Triplex --controller-address http://127.0.0.1:21001 --worker-address http://127.0.0.1:8082 --host 0.0.0.0 --port 8082

this is the log 2024-08-08 14:43:27 | ERROR | stderr | ^MLoading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] 2024-08-08 14:43:29 | ERROR | stderr | ^MLoading checkpoint shards: 50%|█████ | 1/2 [00:01<00:01, 1.59s/it] 2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.15s/it] 2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.22s/it] 2024-08-08 14:43:30 | ERROR | stderr | 2024-08-08 14:43:32 | ERROR | stderr | Traceback (most recent call last): 2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 196, in _run_module_as_main 2024-08-08 14:43:32 | ERROR | stderr | return _run_code(code, main_globals, None, 2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 86, in _run_code 2024-08-08 14:43:32 | ERROR | stderr | exec(code, run_globals) 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 415, in 2024-08-08 14:43:32 | ERROR | stderr | args, worker = create_model_worker() 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 386, in create_model_worker 2024-08-08 14:43:32 | ERROR | stderr | worker = ModelWorker( 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 96, in init 2024-08-08 14:43:32 | ERROR | stderr | self.context_len = get_context_length(self.model.config) 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/utils.py", line 367, in get_context_length 2024-08-08 14:43:32 | ERROR | stderr | rope_scaling_factor = config.rope_scaling["factor"] 2024-08-08 14:43:32 | ERROR | stderr | KeyError: 'factor' `

[surak]

This is the same for phi-3.5

[markswjang]

same for phi-3-mini-128k-instruct

[yxy-kunling]

waiting