practical_seq2seq
practical_seq2seq copied to clipboard
suriyadeepan
A simple, minimal wrapper for tensorflow's seq2seq module, for experimenting with datasets rapidly
trafficstars
Seq2Seq Wrapper for Tensorflow
To make life easier for beginners looking to experiment with seq2seq model. Read the article I wrote on seq2seq - Practical seq2seq, for more details.
Datasets
- [x] CMU Pronouncing Dictionary : Phoneme sequence to word (sequence of alphabets)
- [x] Twitter Chat Log : Sentence to Sentence
Update
After tweaking the dataset to bring down the overall % of unknown tokens to 3%, increasing vocabulary to 8000, the results are promising.
| Query | Reply |
|---|---|
| donald trump won last nights presidential debate according to snap online polls | thought he was a joke |
| trump campaign please never delete this | he was a joke |
| s new scoop is unk the castro connection how trumps company violated the us embargo against cuba | trump is a disgrace to the debate and the media is not a liar |
| who won the first presidential debate | trump will be a better time for a man |
| just wanna live in unk everything is 10x better there | i was just on the same side and i was like it was a good time |
| the lil girl i forgot her name scares the shit out of me n probably always will lmaooo | she was so cute and she was so cute and she was a bitch |
| question of the day who do you think won last nights debate weigh in using | hillary is a trump supporter and a woman who has a better job than a woman |
| trump is a total embarrassment hes like a unk child who happens to be a professional liar and con man | trump is a lot of money to get a great country |
| chill the fuck out | thats what i said |
| so fun to see what the special effects team created for | wow that is the best thing ive ever seen |
| she was fine too unk voice | she is a good guy |
| the important ones are still here | i dont think so |
| been drinking pumpkin spice protein shake every morning for a week and now i literally cannot even | me too i just got it |
| lmao i just lost my job and i cant even leave early to be in the unk video today | literally the same thing |
| hey happy birthday have a nice day | thank you |
~4% unknown tokens in dataset; vocabulary of 8000.
| Query | Reply |
|---|---|
| when are you going to let the police know | you dont know what youre talking about |
| you can do it | yeah i think so |
| wait are you saying that i dont appreciate | i know you know what i mean |
| youre terrible | yeah but im not |
| nah i dont think so | why not |
| hes pissing in our faces again and were just taking it | i cant |
| im sorry i dont know what else to say except im sorry | why would you like to be |
| nobodys gonna get you now get inside | i cant go back |
| shall i leave | of course |
| well i really think hes got a chance | i know |
| youd better be quiet sandy | shut up |
| jesus christ you scared the shit out of me | whats going on |
| well im sorry im really sorry ellie | its okay |
| my lady this play will end badly i will tell | lets get out of here |
| im going to miss you | no youre not |
| what do you mean | i dont know i dont know what i mean |
| my god these people are insane | we dont know what they are |
| this isnt a date | no what is it |
| you ought to go home and take care of that | i cant do that |
| is something wrong | no no no |
Credits
- Borrowed most of the code for seq2seq_wrapper.py from mikesj-public
- Borrowed the twitter dataset from this dude Marsan-Ma
Metadata
569
Stars
273
Forks
Watchers
Owner
suriyadeepan
Metadata
A simple, minimal wrapper for tensorflow's seq2seq module, for experimenting with datasets rapidly