gpt-2 icon indicating copy to clipboard operation
gpt-2 copied to clipboard

how can i get the input and output node names to generate pb file?

Open pragnakalpdev6 opened this issue 4 years ago • 4 comments

I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time.

pragnakalpdev6 avatar Dec 20 '19 07:12 pragnakalpdev6

Hi friend,

Try reference to docs if any help. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/saved_model/README.md

or inspect if you use export_meta_graph method with limit size of graph proto buff if possible in your case.

On Fri, Dec 20, 2019, 14:14 pragnakalpdev6 [email protected] wrote:

I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/openai/gpt-2/issues/221?email_source=notifications&email_token=AEYAML5G2OVQYVN6P3P2YILQZRWGXA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IB4GQ4A, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML4TVPCJKI5HQQYEGD3QZRWGXANCNFSM4J5ZEGBQ .

IveJ avatar Dec 20 '19 17:12 IveJ

Hi friend, Try reference to docs if any help. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/saved_model/README.md or inspect if you use export_meta_graph method with limit size of graph proto buff if possible in your case. On Fri, Dec 20, 2019, 14:14 pragnakalpdev6 @.***> wrote: I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#221?email_source=notifications&email_token=AEYAML5G2OVQYVN6P3P2YILQZRWGXA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IB4GQ4A>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML4TVPCJKI5HQQYEGD3QZRWGXANCNFSM4J5ZEGBQ .

Actually i have the saved model but i want to make frozen graph def of the saved model but i don't know input and output nodes so how can i get that. I also used tensorboard to visualize the graph but i was unable to figure out the graph's input and output nodes. Thanks for the help

pragnakalpdev6 avatar Dec 21 '19 05:12 pragnakalpdev6

Hi Friend,

Plz referrence to docs in gpt-2, this is nodes within both ends of layers in nn, in this case train_loader, validation_loader.

https://github.com/openai/gpt-2-output-dataset/blob/master/detector/train.py

or one of among popular theory equivalence: https://books.google.com.vn/books?id=xxiUDwAAQBAJ&pg=PA102&lpg=PA102&dq=openai+graph%27s+input+and+output+nodes&source=bl&ots=9kv0IurHhE&sig=ACfU3U1L5pQLhUbgrMqQqL9ZlBnjXslKGw&hl=en&sa=X&ved=2ahUKEwikt8_nvcnmAhWTLqYKHf3MBAgQ6AEwCHoECAgQAQ#v=onepage&q=openai%20graph's%20input%20and%20output%20nodes&f=false

On Sat, Dec 21, 2019, 12:04 pragnakalpdev6 [email protected] wrote:

Hi friend, Try reference to docs if any help. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/saved_model/README.md or inspect if you use export_meta_graph method with limit size of graph proto buff if possible in your case. … <#m_1589364898180241536_> On Fri, Dec 20, 2019, 14:14 pragnakalpdev6 @.***> wrote: I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub < #221 https://github.com/openai/gpt-2/issues/221?email_source=notifications&email_token=AEYAML5G2OVQYVN6P3P2YILQZRWGXA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IB4GQ4A>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML4TVPCJKI5HQQYEGD3QZRWGXANCNFSM4J5ZEGBQ .

Actually i have the saved model but i want to make frozen graph def of the saved model but i don't know input and output nodes so how can i get that. I also used tensorboard to visualize the graph but i was unable to figure out the graph's input and output nodes. Thanks for the help

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/openai/gpt-2/issues/221?email_source=notifications&email_token=AEYAMLY7FANC7CV4A6ETSXTQZWPUBA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHOVHGA#issuecomment-568152984, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML22IR75LGOG7XUAIJ3QZWPUBANCNFSM4J5ZEGBQ .

IveJ avatar Dec 22 '19 16:12 IveJ

Hi @pragnakalpdev6

Did you able to get the output node name to generate pb file?

I am also facing similar issues can you please help me to resolve it?

Thanks, Bhavika

bhavikapanara avatar Sep 01 '20 09:09 bhavikapanara