Tommy van der Vorst

WONNX-generated WGSL: ````wgsl alias Scalar = f32; alias GemmVec = vec4; alias GemmMat = mat4x4; struct GemmArrayVector { data: array }; @group(0) @binding(0) var input_left: GemmArrayVector; @group(0) @binding(1) var input_right:...

Seeing a different issue now, when writing the input buffers: ```` [2023-05-23T05:47:19Z DEBUG wonnx::gpu] write input data for input_ids:0 [2023-05-23T05:47:19Z WARN wonnx::gpu] reading int64 input 'input_ids:0' as int32 (int64 is...

Thanks and good to hear `wonnx` is actually being used in production! The way `wonnx` runs an ONNX graph is actually pretty simple: after a pass over the graph to...

Hi @AmineDiro! Sorry, only just got around to having a look at this. Your PR looks good! I would suggest however placing the Erf calculation itself in the activation templates...

Sorry, took a while, thanks for the contribution!

For what it's worth - after the hotfix-6 update (on an e300 / ER-12P) my `wg0` came up but ping failed: ```` ping: sendmsg: Destination address required From 10.42.42.11 icmp_seq=10...

> I found that when I used a DNS name in the endpoint definition it would disappear later. When I used a numeric i.p. address it stuck. > > I...

Should gate this behind a feature flag imo 👍🏻

Having looked at this some more, one other issue I encounter with the current `TopPTopK` sampler is that the biases provided actually *replace* the predicted logits, whereas for biasing towards...

Well eventually I just fully duplicated the `TopPTopK` and added in my changes, and it works great (the samplers themselves are already easily swappable which is great)! So my use...