AMDMIGraphX
AMDMIGraphX copied to clipboard
ROCmSoftwarePlatform
AMD's graph optimization engine.
root@a1aacf20bfb7:~/repo/AMDMIGraphX/build(develop)# ./bin/test_verify "gemm_add" [ RUN ] gemm_add module: "main" @0 = check_context::migraphx::gpu::context -> float_type, {}, {} output = @param:output -> fp8e4m3fnuz_type, {1, 2, 320}, {640, 320, 1} 3 = @param:3...
### Problem Description For softmax operator (axis=2), shape `float_type, {512, 4, 1067, 6}`, the SoftMax JIT-kernel is deployed with: `Global = 139853824` (512 x 4 x 1067 x 64), `Local...
Figure out specs and high level design for this functionallity. Goal: Avoid adding ops directly in torch_migraphx converters incase op specs change within migraphx.
Following pattern seen in Longformer: ``` @1473 = gpu::code_object[code_object=7552,symbol_name=mlir_reshape_reshape_transpose_reshape_dot,global=589824,local=256,](@1463,@1460,@1472) -> half_type, {144, 512, 512}, {262144, 512, 1}: 0.0601688ms, 1% @1474 = reshape_lazy[dims={48, 3, 512, 1, 512}](@1473) -> half_type, {48, 3,...
### Problem Description Seeing this error on Fedora 40 environment. Works fine on Fedora 39. cd /builddir/035_AMDMIGraphX/test && /opt/rocm_sdk_611/bin/clang++ -DHAVE_GPU -DMIGRAPHX_HAS_EXECUTORS=0 -DMIGRAPHX_HAS_FIND_2_API -DMIGRAPHX_HAS_FIND_MODE_API -DMIGRAPHX_PREALLOCATE_MIOPEN_BUFFERS -DMIGRAPHX_USE_ROCBLAS_FP8_API -DMIGRAPHX_USE_ROCBLAS_TUNING_API -DROCBLAS_BETA_FEATURES_API -DROCBLAS_NO_DEPRECATED_WARNINGS -DUSE_PROF_API=1 -D__HIP_PLATFORM_AMD__...
### Problem Description when i run： model.compile(migraphx.get_target("gpu")) it gives error: AMDMIGraphX/src/targets/gpu/hip.cpp:67: get_available_gpu_memory: Failed getting available memory: invalid argument hip.cpp:67 std::size_t get_available_gpu_memory() { size_t free; size_t total; auto status = hipMemGetInfo(&free,...
* With our changes to softmax we no longer use the log_softmax instruction that does the log and the softmax in one step. * We need to make a matcher...
Better handle arguments that requires `--fill1` or `--fill0` for a model inside `migraphx-driver`.
many models have input parameters that are `int` types and usually such parameters are used as indices of some sort or are passed to operators that expect values in certain...
Sort out build pipeline or RHEL builds - [x] Get MIGraphX Build - [x] Get Onnxruntime build with wheels for MIGraphX EP - [ ] Get Onnxruntime build with wheels...
