Taehyun Kim
Taehyun Kim
Can the lib_path be set as a relative path, or an absolute path? I've tried both, but couldn't make it to work. The file libth_transformer.so is there alright, but can't...
There was an issue while remaking the library... I've seen CUDA compatibility issues with FT, but I can't seem to find the post that I've seen. I was using CUDA11.8,...
Does the kernels even work? I set random weights to set up an MoE T5, but I continuously get errors regarding internal errors in CUTLASS MoE GEMM kernel. Any thoughts?...