Zhuofu Chen

I'm curious if there is any example of "high level language being compiled to WebAssembly with multi-memory support"? I searched for a long time but still haven't found any. :(

> > I'm curious if there is any example of "high level language being compiled to WebAssembly with multi-memory support"? I searched for a long time but still haven't found...

yes, that’s what I want to learn. How does this addr space annotations work? > One of the more compelling use cases I've stumbled on is virtualizing interfaces that use...

> > How does this addr space annotations work? > > With Clang and C/C++ it is `__attribute__((address_space(N)))` before the type, though the `N` for the purposes of multiple memories...

> I'm also seeing this, and checked nvidia-smi in a seperate panel to confirm the GPU is being used. GPU column in scalene is empty. The same. I am on...

> Could you please check the `containerd` log and paste them here? Hi Mossaka, I hadn't used `containerd` to invoke `containerd-wasmedged`. The later is an executable in `/usr/local/bin/`.

> Try `mkdir /run/io.containerd.wasmwasi.v1/` That worked! I sucessfully started the `containerd-wasmedged` after mkdir. But now another problem is that when I started the daemon and executeed `sudo ctr run --rm...

Sorry that I didn't start containerd by systemctl. Then I started it and could execute `sudo ctr run --rm --runtime=io.containerd.wasmedge.v1 ghcr.io/containerd/runwasi/wasi-demo-app:latest testwasm /wasi-demo-app.wasm echo 'hello'` in Normal mode and received...

I got the same question. I am instantiate the SinglePrefillWithKVCacheDispatched function, but found that it has `static_assert(sizeof(DTypeIn) == 2);` check. @yzh119 Does this for some implementation consideration?

> The decode attention operators support fp32, we just need to add fp32 to this macro: > > https://github.com/flashinfer-ai/flashinfer/blob/5a38066f171a6c6932fe73693f161e14614e1eea/python/csrc/pytorch_extension_utils.h#L36-L51 > > For prefill/append attention, it's a little bit tricky, because...