Zoli Somogyi
Zoli Somogyi
Thank you for trying to find a way to help me Martin! I actually do not need help in this for a special reason, I never use precompiled dlls for...
I think that the core team who worked most on this project should decide with your lead. I can however tell you what I would do: - I would hugely...
Important read: https://github.com/microsoft/kernel-memory/issues/266
That seems a shared 1 CPU with 4 cores and 8 threads to me (=32vCPU). This is not enough for LLMs. The utilization will also depend on some settings of...
I have just experienced an other problem related to your question. When using CPU the number of spanned threads is about 50% of the available threads. The reason is probably...
Unfortunately, it is not good. You cannot be memory bound with computers of today. If you have 20GB memory is already enough. But most have 64 GB. Or you need...
No problem. For to be sure, I have tested your assumption. I have used the default Threads=null setting and then I have set Threads to the max. cores on the...
I am sorry Martin, but we do not agree in this. Your results are strange for 8 and 16! There is some strange constraints on your PC. More than 16...
In that case we have found the problem and actually we were agreeing all the time about the issue :). Here it is how to do it: ``` ManagementObjectSearcher searcher...
I have no idea, not using Linux/MacOS. But even if it does not work directly, the Net framework should have something similar there too, I guess. In any case, you...