Masaki Kozuki

Adding the new argument of `apply_rate_limting` to `thunder.distributed.fsdp` so that we can try rate limiting of AllGather, for especially when ZERO2 is used. The major changes this pr brings are...

Move Grad AllReduce Bucketing to inside of `thunder.executors.passes.transform_for_execution` from `torch_autograd.split_forward_backward`

1

## What does this PR do? Fixes #184 As per title. The changes are addition of a logic to tell whether or not the input `TraceCtx` represents DDP backward. cc...