tvm icon indicating copy to clipboard operation
tvm copied to clipboard

[TVMC][UMA] Support using UMA with TVMC

Open rafzi opened this issue 2 years ago • 3 comments
trafficstars

This change introduces:

  • A TVMExtension interface to extend TVMC with custom code. Currently its only use is to add UMABackends.
  • A command line option --experimental-tvm-extension <dir> to point to extension modules.
  • An envvar $TVM_EXTENSION_DIR for the same purpose.

See discussion thread: https://discuss.tvm.apache.org/t/tvmc-uma-integration/14309

@Mousius @cgerum @MichaelJKlaiber @PhilippvK

rafzi avatar Mar 01 '23 15:03 rafzi

Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from Reviewers by @-ing them in a comment.

  • cc @Mousius, @gromero, @leandron, @lhutton1 See #10317 for details

Generated by tvm-bot

tvm-bot avatar Mar 01 '23 15:03 tvm-bot

@tvm-bot rerun

PhilippvK avatar Apr 11 '23 08:04 PhilippvK

Sorry for the late update.

The outstanding test failure is likely because of the outstanding issue that the sys.path is modified in order to support all module loading. This probably inteferres with running the tests in parallel.

https://github.com/tum-ei-eda/tvm/blob/c1c2d3ca2db1c56d3cc8d695530ab7aa8b90ea00/python/tvm/driver/tvmc/extensions.py#L24-L34

I'm not sure how to resolve this as I did not find another method to achieve the same kind of module loading. Do we need to compromise here and settle for a simple module load? I unresolved the relevant discussion with @lhutton1.

@cgerum @PhilippvK

rafzi avatar Apr 15 '23 14:04 rafzi