Shan Tang

icon indicating an email [email protected]

icon location Beijing icon location I have been working in IC industry since 2000. From mid-2016, I started working on IC for Deep Learning.

Results 2 issues of Shan Tang

how to use open-source models?

8 comment

Please add examples using local open-source models, like llama or chatGLM. Thanks

Do we have to do tracing in a real system when we try to analyze a 10,000 GPUs training system?

3 comment

Accoring to the Astra-sim 2.0 paper, simulates based on Chakra trace, to "decouple parallelization strategies from the ASTRAsim implementation" . Does that mean we have to trace a real 10,000...

question