hipblaslt_ext::getAllAlgos returns solutions, none of which are supported

[ahsan-ca]

hipblaslt_ext::getAllAlgos returns algos which can then be validated using hipblaslt_ext::matmulIsAlgoSupported. For some cases, all the algos returned are invalid.

This seems to be an issue that hipBLASLt team needs to look into. Collect such cases and logs for hipBLASLt team to look into.

[ahsan-ca]

Observation of investigation:

• On bert-base-cased, we hit the issue of getAllAlgos() returning all invalid solutions, only when we disable MLIR. With MLIR enabled, we do not hit this issue.

I have opened a ticket for this issue against hipBLASLt.

[ahsan-ca]

Feedback from the hipBLASLt team:

This is a standard behavior. getall means to get all the solutions, and when that solution is valid
for a certain size, checked by issuppoted then call matmul.

[ahsan-ca]

Reached out to the team with hipBLASLt logs, have been asked to provide more info, working on collecting that.

Observation: The issue for all solutions being invalid only happens when we disable MLIR.

[ahsan-ca]

I had provided the information requested by the hipBLASLt team, waiting on their response.

[ahsan-ca]

Still waiting on what hipBLASLt team has to say. Keeping this issue around for following up with them.

[ahsan-ca]

hipBLASLt team suggested to use hipblasLtMatmulAlgoGetHeuristic for cases where no supported algo is returned.