Deepak Soma Reddy issues

Repositories
Issues
Comments

Results 1 issues of


                                            Deepak Soma Reddy

Not able see Scaling performance with NuC (12th Gen) with deepseek_r1_distill_llama_8b_q40

I am trying to reproduce the resources on NuC but i see number of token/sec drops when i add more nodes. any help? System: 4xNuC ((12th Gen)) with AVX2 support....