dl_in_nlp_deeppavlov_cs224n_spring2020
dl_in_nlp_deeppavlov_cs224n_spring2020 copied to clipboard
"Deep Learning in Natural Language Processing" - a course by DeepPavlov built on top of Stanford's cs224n
"DL in NLP" by DeepPavlov. Spring 2020
The course is held in Russian. Main platform is this Telegram channel. Lead by Alex Sorokin (@alexeysorokin89) & Vasiliy Konovalov (@letmypeoplego), both affiliated with MIPT. Supported by OpenDataScience, unoffical discussions are held in the #class_cs224n Slack channel.
Main links
- official course repository
- cs224n lectures 2019, playlist
- cs224n lecture notes
- Lectures and seminars by DeepPavlov, playlist :ru:
- Telegram channel "DL in NLP Spring 2020" :ru:
- DeepPavlov forum :ru:
- Task grading FAQ :ru:
- A list of useful resources from spring 2019 course session
Week 1. Word Vector Representations
-
Lectures:
- Word Vector Representations (word2vec)
- Word Vectors and Word Senses (0:00-38:40, 58:00-1:20:00)
- cs231n lecture
- cs224n lecture notes
- FastText paper
- GloVe paper
- cs224n lecture on GloVe by Richard Socher (2nd author)
- a lecture on FastText by Facebook
- A particuliarly good tutorial on word2vec by Chris McCormick: part1, part2
-
Quiz 1 due on Feb 10th, 9am Moscow time.
-
Quiz 2 due on Feb 17th, 9am Moscow time.
-
** Assignment 1.** Github Classroom invitation link. Due on Feb 18th, 00:00 MST.
-
Assignment 2. Studying word embeddings and implemeting word2vec. Github Classroom invitation link. Due on March 20th (extended), 23:59 Moscow time.
Weeks 2-4. Basics of neural networks
Week 5. RNNs and language models
Now that the official course repo is constantly updated, better to follow that one.