model-optimization icon indicating copy to clipboard operation
model-optimization copied to clipboard
verified publisher icon tensorflow

Does anyone try to apply this project to BERT?

Open guotong1988 opened this issue 6 years ago • 7 comments

https://github.com/google-research/bert Thank you very much!

guotong1988 avatar Jul 05 '19 02:07 guotong1988

Not that we know of. I don't believe the open source bert trainer uses Keras. It would beb nice to see somebody trying it out though.

raziel avatar Jul 10 '19 05:07 raziel

@haozha111 is trying this out

alanchiao avatar Jul 31 '19 20:07 alanchiao

@haozha111

how to apply this api to bert? do you train bert by keras? can we use bert trained by tensorflow?

Jasperty avatar Aug 01 '19 08:08 Jasperty

The pruning API only supports keras model right now. I'm just starting to trying it out, and don't have any code examples now. Will post here once I get some good results. Thanks!

haozha111 avatar Aug 01 '19 15:08 haozha111

Hi @haozha111, is there some updates?

teijeong avatar Apr 14 '21 09:04 teijeong

The pruning API only supports keras model right now. I'm just starting to trying it out, and don't have any code examples now. Will post here once I get some good results. Thanks!

Hi @haozha111, is there some updates?

lan2720 avatar May 17 '22 08:05 lan2720

no, I haven't tried it recently. if you are interested, please follow docs in https://www.tensorflow.org/model_optimization to apply it to BERT, also cc'ing Jaesung who is currently working on MOT.

haozha111 avatar May 18 '22 01:05 haozha111