sunnsi comments

Results 6 comments of


                                            sunnsi

`@distributed` fails on loops over iterators

Does any one tell me whether the macro "@distributed" work on iterators now? I have a very large data array (more than 900,000,000) after combinations, collect() function will exhaust all...

`@distributed` fails on loops over iterators

Thanks, mbauman. I will try your suggestions.

error:"input values have 2 keys, you must specify an input key or pass only 1 key as input

I met the same issue, waiting for the update.

[Bug] 使用Release编译的balance_serv，运行时卡在sched_rpc started with PID: ，dmesg查看出现段错误

+1 使用Release和Debug编译都会出现同样才错误。 ```bash [1292956.655475] python3[1021259]: segfault at 1e0 ip 00007f0c72283b17 sp 00007ffda6f149e0 error 4 in libsched.so[7f0c72267000+69000] ```

Regarding the issue with Multi-Concurrency Support, when using the backend_type and balance_serve parameters, a segmentation fault (segfault) occurs at the final stage of model loading.

I met the same error. ```bash python ./ktransformers/server/main.py --port 10002 --model_path deepseek-ai/DeepSeek-V3.1 --gguf_path /data/llm-models/unsloth/DeepSeek-V3.1-GGUF --optimize_config_path ./ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-serve.yaml --cache_lens 32768 --chunk_size 256 --max_new_tokens 8000 --max_batch_size 4 --backend_type balance_serve --architectures DeepseekV3ForCausalLM ``` dmesg:...

Regarding the issue with Multi-Concurrency Support, when using the backend_type and balance_serve parameters, a segmentation fault (segfault) occurs at the final stage of model loading.

@magikRUKKOLA Thanks for the information. I will have a look at ik_llama.cpp.