gpt-2 icon indicating copy to clipboard operation
gpt-2 copied to clipboard

Documentation out of date

Open andytriboletti opened this issue 4 years ago • 2 comments

I noticed this PR which updates the DEVELOPERS file: https://github.com/openai/gpt-2/pull/181

It is not yet merged.

I was reading through https://github.com/openai/gpt-2/blob/master/DEVELOPERS.md

I tried pip3 install tensorflow==1.12.0. I found that version doesn't exist. I used: pip3 install tensorflow==1.13.2

It seems to work with this version - however it stopped mid sentence and had some warnings. I am using a Linode, the default size version with the latest Ubuntu.

python3 src/generate_unconditional_samples.py | tee /tmp/samples
/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/dtypes.py:526: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/dtypes.py:527: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/dtypes.py:528: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/dtypes.py:529: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/dtypes.py:530: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/dtypes.py:535: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
2019-11-09 17:03:09.817453: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2019-11-09 17:03:09.823008: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 1999990000 Hz
2019-11-09 17:03:09.823403: I tensorflow/compiler/xla/service/service.cc:150] XLA service 0x315f5f0 executing computations on platform Host. Devices:
2019-11-09 17:03:09.823491: I tensorflow/compiler/xla/service/service.cc:158]   StreamExecutor device (0): <undefined>, <undefined>
WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/op_def_library.py:263: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.
Instructions for updating:
Colocations handled automatically by placer.
WARNING:tensorflow:From /root/gpt-2/src/sample.py:64: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
WARNING:tensorflow:From /root/gpt-2/src/sample.py:67: multinomial (from tensorflow.python.ops.random_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.random.categorical instead.
WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow/python/training/saver.py:1266: checkpoint_exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version.
Instructions for updating:
Use standard file APIs to check for files with this prefix.
2019-11-09 17:03:16.296025: W tensorflow/core/framework/allocator.cc:124] Allocation of 7077888 exceeds 10% of system memory.
2019-11-09 17:03:16.296514: W tensorflow/core/framework/allocator.cc:124] Allocation of 154389504 exceeds 10% of system memory.
2019-11-09 17:03:16.366548: W tensorflow/core/framework/allocator.cc:124] Allocation of 9437184 exceeds 10% of system memory.
2019-11-09 17:03:16.406170: W tensorflow/core/framework/allocator.cc:124] Allocation of 9437184 exceeds 10% of system memory.
2019-11-09 17:03:16.433514: W tensorflow/core/framework/allocator.cc:124] Allocation of 7077888 exceeds 10% of system memory.
 
======================================== SAMPLE 1 ========================================

Worcester Uinger and Worcester Ugo were dismissed from Sheffield United's squad on Tuesday for a clash in southport despite High Five Scotland's injures involving Ukafor, Blais and C Stevens taking the spot, the Yorkshire side

Newcastle: Shaun Wright (left) had been named as the 18th captain

the squad attending Stuart Holden's next game will now be relegated to Northolt

Media playback is not supported on this device No/Wyrandsie: Out of body does Neeskens get an anti-kicking award

Norwich: Ayew played 17 minutes of the match, stretched out on 15 completions to Robin Huddlestone for his 34 to George Graham - a move that was denied when midfielder Thierry Henry became frustrated with his opponent

Charlton's Ashley Griffith for his 25 - his first quarterbackacking change of late - retired S Dyrde's double kick to Ryan Gunn to get a first two for the Heat after Lowell Waite opened the scoring in DET's central halffall - but Wycombe Man Watson shot wide and vented his anger to the All Blacks in penalties down the line

Norwich: Ugaawe Matukwo was outstanding on the number 25 spell, extending his unbeaten run - 10 straight

Charlton side: Fit, Sam Adams, Acic Iwako, Stewart Neely, Marcell Sene who closed - but Henry made the scorebar by part way - with the Pavilion at 1-1

Liverpool: Shearer taken on a a two-month suspension (tail to nose tackle) from Derby this morning - first spent the night he was in France because of incontinence

Banks: Prior to Saturday's media day update Watford were next games on their road trips to Aberdeen Vale, Newport but will be without Sene still

Wolverhampton Wanderers vs 13: AFC Wimbledon huddle up on the same pitch as Bristol City (Jan 12, 2008) Titans 17, Circuit last

Champions League: A Picture of The Midlands Derby at the Stadium of Light is seen in Green Lane

Only Premiership sides face away with equal record by a on average 11 points, painted as "fata di noblico" or "play for seven", Cardiff Blues FC v Manchester City V20, Crystal Palace v Everton and Hull City v South Wales after taking a 0-0 draw at Hampden. Bournemouth got 15 per cent. Stoke prevented Everton scuffling. Villarreal v Ipswich City V20, Ipswich strip, Bournemouth out of the race for contention.


Transfer deadline day's top predictions for the transfer market for back-to-back seasons:


West Brom's Xia-hu for £42m (Chomey Pereo United). Afterwards, Roberto di Matteo for the remaining two years (in April), Nicolas Otamendi for less giving-a-phone fees (in 2011) as Mumbai-born Demonelopoulou played only 20 Premier League snaps. Qatari English Fokoamils investing 4 million of £5m into his side, now with just 6 Farmers Trophy catches. Molineux attended MK Dons training, fielding his outfield and U6 timeout. Manchester United Hotspur are out of the race for Darwen Champlain, doing what West Brom's Chris Pearson did - their bowl dipped as far as 0.78 goals per match. Nacional at Charlton, Omar O Torres for 26 minutes before chilling off from friendly vs Chibadjrian. on loan Spalletti for his first half scoring against Liverpool (40) (I called off Bournemouth) while Dunford zip swift for third half form with former payoff Earnolls by Crusaders scratched by Charlton for incontinence from Toreanga keeper Fabian Edrat (McManaman surprised by a recovery). Carolina after word directly from manager Howley. Barcelona – former spouse Seylocent at Premier League level Qunyuan in love with Tobi McFarran Guan, training with San Marcos only eight weeks before Chelsea released him to failings bone and glass. Crawley paid MG Radhams twice as sanction, trailing from their 544th draw in 2010-11, after being jostled & bounced. Visit Chelsea - Roger Salisbury in February, Dani Alves building forever on experience of dealing's rampant couple Scudetto-Addy clip Real Rangers 9-17 Californ, Marseille winning the £25m Christmas holiday. FC Santander AGU early training with Gregory Trie, Chizal keMed to script your perfect fight Such dry extinguished roof and must conference cup finals I am less confident ZORSFC owners Glenn Hoddle (RUBIC SCIFI REAL SCIFI SLAUCHercombe) Charlie opens something! La Scudetto win 118 points DE PREO de Porto until Sunday between Vecchio and Ray Barrie To boot, with Breredé Sty team me Raú
======================================== SAMPLE 2 ========================================
a pair of blushes. After having one of them for mere cause, so to speak, the blonde surprised, and inquired whether she would take those in a fight? And underneath that devoured glory waxed and waned like the microscopic claw of alcoholism, suddenly she found what she needed - something different. Suddenly everything fell overboard

Child Sarah seized her astonishing wand and locked her lover in a corner, threatening him with the knuckle phone. Sarah didn't have the emotional energy to follow in the ears of her store or contemplate that act, so she opted for a distraction with a concealed camera beside her, hoping it would reveal real-life innocents lurking out there being popped for smoking. Then Sarah started the notes, the feline lips moving in unison with between eyebrows of their haunting non-trigger scribblings. Eventually, again with uninterrupted detail, the letter reading 'Iraq-sample prints'.

The friends did not seem to mind. A urbane musical goof bruiser on the arena floor pissed their teeth. Some were Robin CD's, some of them nabbed for £20 an hour and the likes. Lots of rich behaviour and lovd. And more: the blonde blushing recounting the trick by showing herself standing in a square and pinned to a pretty newspaper then offering the listen, seemingly stunned by the gaudy monstrosity. As if suddenly lost in thought for a minute after her boyfriend's scarily brief caress was snapped, Sarah invited Neal to become what had been supposed to be she once was, then tucked the sickening items into a locked drawer, trying not to let it be understood that the Aberdeen Bar had failed them since its peak

Photographer Laura Bowdich toured the basement stage of the loud yet sumptuous armoured playhouse, alongside her friend and fellow art gardener Brian Hill, with just hours and unheard camera efforts with her. Asword and the recklessly nautical soundtrack quieted the crawlish breeze whilst the drug- and alcohol-addled crowd chopped up the brains of your enemies. Rests of quirkiness followed the lush, garish aura of almost every one. The thing that made this world's great southern art 'dead works' i.e. sloppy working but very apparently sweet, may as well get exported to this East Deptford paradise.

So pleased with this ghoulish attempt to absorb all the terms of quirkiness it would redeem itself when it arrived it chirped. It had been caught, and impressed, with the provocative outton claims, although with poor preparation for his use. We have a 'n—', just if not a 'k', reason to heed his side of the change. Will it go on in any other government collection? A prickly treat for a guy who's a charity organizer at some pre-war PtheonYes! party in Mendoza where other BABYLEG UNITS which are also being scrounging for their latest $10 million minimum is topical use? Or is, in some cases,, a silenced attempt to verify their outing by some mño-mphigantre-fish?

There was a short pause before the animal rights groups agreed with the announcement that the whole secrecy, colloquialisation and admirable naïveté was going to get them the moment they, comfortable with what was glossed over in an otherwise dishonorable assortment of adjectives, were all baskatively welcomed to reveal because at the end we all know this is nakedly, to learn, extremely hopeful money window would fall. We are ballistic18tops pushing in so far as centre lies, this time because, from an mightier's point of view, calculating R&J. Bjerken brought perusal to the taboo subject with the blushes. But Sarah nursed parties, contests, marriages and even visits to tattoo fairs and churches where little they were more obscure than its evasions about something characterised as something bucketheap-soaked fiendishly fell hard upstairwell or sickly smashed. It was revelation. (For those uninitiated, 'medieval Britain' constitutes not only British imperialism, but Christian rump Britain and the Chesterton luddite Protestants across the nautical edge of the Caribbean.) Sarah seemed to be begging for more transparency about public bulk, something in emerging directions, something that isn't at all secret.

Stuffed around her lips was a plate of trapped low-fat lip cocktail beverage, all of which somehow, like a single word at a all-Ireland-specific Hip-Rock English pub, was some sort of S-C-I-D — a faintly 'hingerstep moment'-boosting drug – suddenly spilling from the bottle. It was extremely attractive to look at and stick around Bennett But Understanding's local boardroom tables. Many have seen jars that list half hats, or perhaps about Snakes and Bees. (This was the place of the Hutchinson twins' 25-hour break for eating. Which begs the

andytriboletti avatar Nov 09 '19 17:11 andytriboletti

You can install 1.12.0 version using anaconda (conda install tensorflow-gpu==1.12.0), but in this case, you need python version 3.6 or below.

grigolp avatar Nov 10 '19 10:11 grigolp

Related to #189. Try installing 1.14 and see if it works.

jextrevor avatar Nov 11 '19 01:11 jextrevor