Ivan Yashchuk

## 🚀 Feature ### Motivation Currently, if kwargs is of nonzero length then all bound symbols are set to be not equal to each other: https://github.com/Lightning-AI/lightning-thunder/blob/33b36ec33442e4ae921b8913d8bc728d4451b596/thunder/core/symbol.py#L672-L673 This needs to be...

Add MoE layer example

4

**DRAFT MODE TO PREVENT MERGES** The approach and code is ready for experimentation and review. The main result of this PR is that Thunder can run a variant of the...

Add support for FP8E4M3 and FP8E5M2 dtypes

2

## 🚀 Feature Currently supported dtypes are listed in this conversion dict: https://github.com/Lightning-AI/lightning-thunder/blob/17024fa1c805c4c7bc37673be26fac4ef7a1b64f/thunder/core/dtypes.py#L504-L535 PyTorch has recently added support for FP8E4M3 and FP8E5M2 dtypes and we need to add them to...

Enable apex tests

3

Fixes https://github.com/Lightning-AI/lightning-thunder/issues/220

Remove all occurances of thunder.compile and TestExecutor.make_callable_legacy

10

## 🐛 Bug All `thunder.compile` usage in the repo should be replaced with equivalent `thunder.jit`. Two places in the test framework use `thunder.compile` today, the tests should be rewritten to...

`thunder.distributed.utils.sort_waits` is broken

2

## 🐛 Bug `thunder.distributed.utils.sort_waits` is broken in that it does not sort the waits to be close to the consumers. The effect is that we don't have overlap of communication...

Thunder's nvFuser executor got support for `prims.linear` in https://github.com/Lightning-AI/lightning-thunder/pull/318. This PR updates the test * to use the sample generator from OpInfos * to reject linear execution if inputs are...