Open-Textbooks
Open-Textbooks copied to clipboard
bsgreenb
A library for scraping nearly every college bookstore in the US
bncollege now has implemented obfuscation, as well as dynamic javascript content generation. simple curl/wget processes will not work. it appears that one will need a headless browser solution -- casperjs/phantomjs/webkit/selenium+py+browser....
It appears that BNCollege, and potentially others, use a javascript redirect to prevent scraping. Here is a workaround (on Android) using a webview: `WebView view;` Then in, for example, `onCreate`,...
Hi We are using the Open-Textbook scraper to fetch the book details for the universities, but unfortunately for some of the universities it returns no results. Some of the universities...
I do not seem to have any luck finding the mobile sites for simplifying scraping from MBS Direct sites.. According to the documentation, http://bookstoreurl.com/mobile/textbooks.aspx should give me the mobile version......
It's been reported that a bug occurs when `run_through.php` reaches a (bncollege) school with multiple campuses dropdown. E.g.: http://cpcc.bncollege.com/webapp/wcs/stores/servlet/TBWizardView?catalogId=10001&storeId=65138&langId=-1 This doesn't appear to be a bug in the actual API/code,...
