trytolose

@mcarilli It's clear how to switch with o1, but how I can use o2 optimization with torch.cuda.amp?

@gaotongxiao Hi! Any news about SVTR? It's very interesting for me, because I can't reproduce paper's results by myself.

I have same issue too