Shaden Smith

icon indicating a website link http://shaden.io/ icon indicating an email [email protected]

icon company @Microsoft icon location Bellevue, Washington icon location Technical Staff @ Microsoft AI. Passionate about high performance computing and machine learning.

Results 5 issues of Shaden Smith

model parallel norm and overflow tests

1 comment

enable apex.optimizers.FusedAdam and deepspeed fused fp16 optimizer

1 comment

If a client provides an optimizer of type `apex.optimizers.FusedAdam`, it won't be given a fused FP16 optimizer. The `isinstance()` query here only checks for DeepSpeed's `FusedAdam`. The implementation here was...

FP16 fused and unfused grad norm query.

2 comment

MEX (Octave/Matlab) interface also needs to have unit testing.

1 comment

I have very little experience with Matlab -- is there a good unit testing framework that I could use? Bonus points if it works in Octave as well, so I...

enhancement

CPD initialization

Right now the CPD can only be initialized randomly and controlled via the command-line seed parameter (`--seed=`). We should add the ability to initialize based on input files, etc.

enhancement