Tianqi Chen

[DISCUSS] Execution Environment for Asyncify Lightweight Synchronize System Calls

21

## Background One of the primary goal of WASM is to run on the web, and web is async in nature. On the other hand, there is always a need...

[NOTICE] Transition from ChatModule to MLCEngine

4

As we start to formalize MLC LLM Engine, we are moving towards a more comprehensive API that is OpenAI compatible. This means a lot of new features that allows us...

[Feature Request] Change OpenAI protocol default value to NOT_GIVEN

6

## 🚀 Feature As of now OpenAI API protocol set the direct default values. From the endpt pov, it is better to set most values to be NOT_GIVEN, as per...

[DISCUSS] Compute Shader non-buffer arguments

7

Hi WebGPU community: I would like to use this issue to call for a discussion about what is the best way to compile compute shader kernels with non-buffer arguments. Compute...

[Tracking] Sentence Embedding Model

2

## Overview This is a global tracking issue to bring generic sentence embedding models to MLCEngine. ## Action Items - [ ] Add support for mistral based sentence embedding ##...

[Tracking] Create a CPU Compatible PagedKVCache

1

## Overview It is useful to have an CPU/NPU compatible PagedKVCache for general compact purposes ## Action Items - [ ] Provide a CPU compatible PagedKVCache kernels ## Links to...

[Flaky Test] test_relax_2d_buffer_allocation.py

2

Seems there are some flaky test cases in hexagon during recent PRs that do not have to do with the feature ### Test(s) - `tests/python/contrib/test_hexagon/test_relax_2d_buffer_allocation.py::test_alloc_storage_with_scope_global` ### Jenkins Links - https://ci.tlcpack.ai/blue/organizations/jenkins/tvm-hexagon/detail/PR-16807/5/pipeline...

This PR brings up new reflection support in python. The new reflection now directly attaches property and methods to the class object themselves, making more efficient accessing than old mechanism....

Since the term synchronize may cause confusion that user thought it means stream sync, it simply means we pass the right current stream as env stream

[DLPack] Update to include DLPack C Exchange API

3

This PR updates to include dlpack C exchange api for fast exchange at c-extension level without going through python.