kgboyko

[Bug]: Kernel crash while loading the 14B models on GPU L4x4

1

### Your current environment The output of `python collect_env.py` ```text Collecting environment information... PyTorch version: 2.5.1+cu124 Is debug build: False CUDA used to build PyTorch: 12.4 ROCM used to build...

The program hangs after using the debugger

2

Type: Bug The program hangs after using the debugger After setting a breakpoint in a Jupiter notebook cell and then running the program, the program hangs in a subprocess. Steps...

The program hangs after using the debugger

2

Type: Bug The program hangs after using the debugger After setting a breakpoint in a Jupiter notebook cell and then running the program, the program hangs in a subprocess. Steps...