Thomas Viehmann comments

Results 227 comments of


                                            Thomas Viehmann

allow tracing models on meta device

This has now been achieved.

in generators (and async generators / coroutines, too), exception handling during yield should be done by the generator

So what needs to be done is in the above snippet to call into run_frame but instead of executing the next instruction to immediately jump to the exception handling. Probably...

in generators (and async generators / coroutines, too), exception handling during yield should be done by the generator

Not as urgent.

Prologue error: check_slice_value fails with function wrappers and closures

Extracting the prologue from the traceback (I'll send a PR to assign to last_prologues before running) it looks a bit like a naming / proxy id collision somewhere to me...

Prologue error: check_slice_value fails with function wrappers and closures

Seems to be working for me now.

conv backward in thunder

The decomp working is what we see with #655 in fp6, too. But I think we would want to look into whether the decomp has perf or numerical accuracy impacts.

conv backward in thunder

Note that this is more for investigation and knowing what's going on than any set conclusion. Comparing to fp64 in this trivial example it seems that we're not worse than...

Raise an error when PyTorch's activation checkpointing is used with Thunder-jitted model

I wonder how hard it would be to actually support basic CheckpointWrapper by having a "container symbol" and defining a grad transform that includes the forward in the backward...

[Feature request] Optional debugging option to get trace with information on tensor strides along with tensor shapes

Hi @parthmannan , thank you for filing this! Let me pick your brain a bit: Maybe we could have an advanced debugging tutorial where we define a symbol with an...

Drop thunder.compile

Closed by #1114 built on #837.