AphidGit

Results 11 comments of AphidGit

I'm using Arch linux (updated to latest) and this very same problem has started to appear for me. As ModTheSpire is a java program, I can get out of the...

!! https://github.com/ROCm/rocprofiler/ _still_ now appears to depend on aqlprofile, which is blacklisted as closed source. The provided/linked patches by littlewu above no longer suffice to extirpate the connection. I tried...

I wrote a new patch for rocprofiler; https://github.com/AphidGit/rocm_compile/blob/main/rocprofiler.patch This should compile the current git master version of rocprofiler. Note; the error above is due to a newly introduced dependency on...

If there is enough memory, it might be faster to load the model weights into memory on both NUMA nodes using numa_alloc_onnode from libnuma, then bind half the threads to...

That suggestion breaks things even more. `RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test`

Note: This can be solved by hard-copying the headers (or linking them in) like so; ``` mkdir -p "$BASEDIR/09_hip/hip/hsa"; rsync -av "/opt/rocm/include/hsa/hsa.h" "$BASEDIR/09_hip/hip/hsa/hsa.h"; mkdir -p "$BASEDIR/09_hip/hip/include/hip/hcc_detail/hsa/" rsync -av "/opt/rocm/include/hsa/hsa.h" "$BASEDIR/09_hip/hip/include/hip/hcc_detail/hsa/hsa.h";...

A dependency diagram would be helpful... I don't know what depends on what and there's 40 of these repositories before I arrive at my goal. But no, I am installing...

I would be very careful to use this kind of safeguard. It's possible for the user to get the LLM to output the intended script injection by gaslighting it into...

I've been having the same problem with rocm 6.0.2. For me, HSA_OVERRIDE_GFX_VERSION has no effect. I briefly (for about half a second) had my GPU turn my screen into random...

I'm pretty sure it's not a hardware issue. I updated rocm recently to use/run LLMs, and that worked just fine. Prompt processing is also a pretty heavy load, and I...