PPLM

PPLM copied to clipboard

pplm with gpt-neo

8

https://github.com/uber-research/PPLM/blob/e236b8989322128360182d29a79944627957ad47/run_pplm.py#L610 I'm trying to implement gpt-neo with PPLM. however gpt-neo meeds upgarde transformers liberary to transfoermers>=4.5; where 'past' is replaced with past_key_values. when I change past to past_key_values I got...

AJamal27891

Filtering words composed of more than 1 token

5

Hi, thanks for the great works. I see that you are filtering out words that are composed of more than one token: https://github.com/uber-research/PPLM/blob/5f27e191798b832b51cfc9a83697afd83dc4832c/run_pplm.py#L390, which makes it filter quite a bit...

mataney

Are the bag of words case-sensitive?

1

Hello, I find that some words are cased while some are uncased. They have different word ids in the vocab of tokenizer of GPT. What is the appropriate way to...

yananchen1989

I am trying to train a discriminator on my own (the network learns to differentiate between text from one specific source from generic text ) . The idea is that...

Sujit27

Porting into latest version of transformers & torch

2

Hi, Recently I've been working on Conditional Text Generation for [2021 OSAM Hackathon](https://github.com/osamhack2021?q=pplm&type=&language=&sort=) in Korea, [Our team](https://github.com/osamhack2021/AI_WEB_POOL_YD) tried your paper code, in order to generate some sentences suitable for job...

woosukji

aj7tesh

Is it possible to apply PPLM to encoder-decoder models (such as BERT2GPT2)

3

nooralahzadeh

versions of all packages in requirements.txt

2

hello, could you specify the version of all packages in you environment?

hurricanedjp

Performances

3

Thanks for open-sourcing the code ! This approach is very interesting, but I'm curious about the impact on performance (inference speed). **Is there any benchmark showing the impact on performance...

astariul

Hello, I want to ask about the difference between `BAG_OF_WORDS_ARCHIVE_MAP` in this repository and HuggingFace Transformers examples/research-projects/pplm. In run_pplm.py in this repository, https://github.com/uber-research/PPLM/blob/5b262d6b625fae063e085a1f59aa40b7c7854fb5/run_pplm.py#L58-L68 On the contrary, in run_pplm.py in the...

forest1988