mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Runing mlc-llm python code on windows fail

Open lucasjinreal opened this issue 2 years ago • 2 comments

Hi, tried to run python (gen my self), got some errors:

Check failed: (it != self_->idx_sub_.end()) is false:

I built tvm unity branch it import correctly, but runtime error when run python .\tests\chat.py

Full traceback:

Traceback (most recent call last):
  File "E:\codes\ai\aichat\mlc-llm\tests\chat.py", line 13, in <module>
    from mlc_llm import utils
  File "e:\codes\ai\aichat\mlc-llm\mlc_llm\__init__.py", line 2, in <module>
    from . import transform
  File "e:\codes\ai\aichat\mlc-llm\mlc_llm\transform\__init__.py", line 1, in <module>
    from .dispatch_tir_operator import DispatchTIROperator
  File "e:\codes\ai\aichat\mlc-llm\mlc_llm\transform\dispatch_tir_operator.py", line 6371, in <module>
    get_dict_key(fused_min_max_triu_te_broadcast_to): fused_min_max_triu_te_broadcast_to_sch_func(),
  File "e:\codes\ai\aichat\mlc-llm\mlc_llm\transform\dispatch_tir_operator.py", line 30, in fused_min_max_triu_te_broadcast_to_sch_func
    sch.reverse_compute_inline(b0)
  File "e:\codes\libs\tvm\python\tvm\tir\schedule\_type_checker.py", line 339, in wrap
    return func(*args, **kwargs)
  File "e:\codes\libs\tvm\python\tvm\tir\schedule\schedule.py", line 2218, in reverse_compute_inline
    _ffi_api.ScheduleReverseComputeInline(self, block)  # type: ignore # pylint: disable=no-member
  File "e:\codes\libs\tvm\python\tvm\_ffi\_ctypes\packed_func.py", line 237, in __call__
    raise get_last_ffi_error()
tvm._ffi.base.TVMError: Traceback (most recent call last):
  File "E:\codes\libs\tvm\src\tir\schedule\primitive\compute_inline.cc", line 537
TVMError:
---------------------------------------------------------------
An error occurred during the execution of TVM.
For more information, please see: https://tvm.apache.org/docs/errors.html
---------------------------------------------------------------
  Check failed: (it != self_->idx_sub_.end()) is false:

Any help here?

lucasjinreal avatar May 04 '23 08:05 lucasjinreal

Some of the functionalities for dynamic shape have not been upstreamed yet, please use the relax repo for now.

yzh119 avatar May 04 '23 22:05 yzh119

Yep please use this repo: https://github.com/mlc-ai/relax

junrushao avatar May 08 '23 22:05 junrushao

Windows should work in my experiments

junrushao avatar Jun 05 '23 15:06 junrushao