Ryan Hughes

Sounds like a great idea, but this will only allow people to work a small part of the backend without actually running the full scrapers. With this, they could run...

Oh another thing - once we merge Jenning's code for the new version of Banner the scrapers should take

Sounds good to me! Once we add the ability to re-use data that we have already scraped we can load in all the data all the way back to 2012...

I agree this would be super cool. We can use the same search backend (and endpoint) too, instead of creating a different search pipeline for this. The current search is...

If you refresh the page or search for something else the results will move down and it will look normal again. It's not that big of a bug because you...

You are talking about when a class is at the Seattle campus, vs the Boston campus, vs something else like Burlington, right? Do you have an example of a class...

Awesome!!!!!! I was totally planning on writing scrapers for the TRACE surveys haha. This will help a lot! :D Right now, all the scrapers on Search NEU are ran daily...

> lots of CPU + RAM ... and takes 24 hours to run The current scrapers for Search NEU run on Travis-CI ( https://travis-ci.org/ryanhugh/searchneu/builds ) as a daily cron job....

TBH this hasn't gone anywhere for a while. If you are interested in building one i'd be happy to give some pointers

One of the big hurtles with scraping TRACE info is that students have to log in to view them. If you write scrapers to solve this, your scrapers are going...