DeepSpeed
DeepSpeed copied to clipboard
fix return prev key and value , added strides to from_blob
fixing issue https://github.com/microsoft/DeepSpeed/issues/2760 basically just fixing from_blob strides , before the fix the functions returned key and value cache that was populated by zeros.