NLP-project
NLP-project copied to clipboard
11411 Natural Language Processing Final Project. Reads wikipedia articles, and then can both answer natural-language questions about the article as well as generate comprehension questions. Built usin...
NLP Term Project
11411 Group 6 Project. See NLP Project Page
Contributors
Timeline
- Thursday February 7, Stub Program (Ryhan) & Initial Plan (Daniel)
- Tuesday February 26, Progress Report 1 (Stephen)
- Thursday March 21, Progress Report 2 (Ryhan)
- Tuesday April 9, Dry run system
- Tuesday April 16, Project code due
- Tuesday April 30, Demos at Google
- Thursday May 2, Final Report
Asking Program
./ask article.txt nquestions
The asking program takes an
-
article.txt
containing a Wikipedia article and - an integer
nquestions
.
Answering Program
./answer article.txt questions.txt
The answering program takes an
-
article.txt
containing a Wikipedia article and - a textfile
questions.txt
containing one question per line.
Getting Started
Permissions
chmod +x ask
chmod +x answer
Installing NLTK
First download setuptools
, http://pypi.python.org/pypi/setuptools
sudo sh Downloads/setuptools-...egg
sudo easy_install pip
sudo pip install -U numpy
sudo pip install -U pyyaml nltk
Download NLTK datasets
python
>>> import nltk
>>> nltk.download()
Once the NLTK Downloader GUI pops up, download all to /Users/USERNAME/nltk_data