Reza Yazdani

> Also should probably assert if `int4` attempted to be used w/o `deepspeed>=xyz` once the DS PR is merged... could tentatively set to the next deepspeed version? perhaps with XXX...

> is simple, unambiguous and future pro Hi @stas00, I agree with what you said, and we are going through the same route as you see from my last commit...

In that case, we > > is simple, unambiguous and future pro > > Hi @stas00, I agree with what you said, and we are going through the same route...

> may I suggest that the just added `kwargs['quant']['weight']['num_bits']` isn't the most user-friendly API as far as `kwargs` go? > > why not have a flat structure of simple key=value...

> > > may I suggest that the just added `kwargs['quant']['weight']['num_bits']` isn't the most user-friendly API as far as `kwargs` go? > > > why not have a flat structure...