ONE icon indicating copy to clipboard operation
ONE copied to clipboard

Generate model with int4 weight ( maybe single op model )

Open chunseoklee opened this issue 11 months ago • 2 comments

There are several options to generate this :

  • circlechef : https://github.com/Samsung/ONE/issues/12741#issuecomment-1993918881 (draft)
  • https://www.tensorflow.org/model_optimization/guide/quantization/training_comprehensive_guide#use_custom_quantization_algorithm
  • manual generation with flatc

chunseoklee avatar Mar 14 '24 04:03 chunseoklee