uoft-scrapers icon indicating copy to clipboard operation
uoft-scrapers copied to clipboard

UTSC timetable scraper

Open qasim opened this issue 11 years ago • 7 comments

The UTSC timetable needs a scraper.

qasim avatar Apr 18 '15 06:04 qasim

Hey I can work on that

vatdaell avatar Apr 02 '16 01:04 vatdaell

@vatdaell Cool! Here's where the file for it is: uoftscrapers/scrapers/timetable/utsc/__init__.py

And these are the places I found where UTSC posts info. If you're a UTSC student, you may know better.

  • http://www.utsc.utoronto.ca/~registrar/scheduling/timetable for Timetable info (course times / offerings)
  • http://www.utsc.utoronto.ca/~registrar/calendars/calendar/Programs.html for course descriptions

Keep us updated if you find anything else / want feedback!

qasim avatar Apr 02 '16 02:04 qasim

Hey, I think we might have a problem with the UTSC calendar due to the current formatting of the utsg calendar. Some things do not apply to UTSC courses

vatdaell avatar Apr 14 '16 01:04 vatdaell

@vatdaell Like what?

arkon avatar Apr 14 '16 01:04 arkon

@arkon enrollment numbers and limits are not public as of now. Also I'm not sure what id is used for. Plus are breadths just the breadth that each course belongs into?

vatdaell avatar Apr 14 '16 01:04 vatdaell

@vatdaell You can set enrolment numbers / limits to zero by default in that case.

id is a unique identifier for the course. Basically it's split into the following pieces:

  • CSCB09H3Y20165
    • CSCB09: The code of the course
    • H: The course length (H is half term, Y is full year)
    • 3: Campus identifier (1 = UTSG, 3 = UTSC, 5 = UTM)
    • Y: The length the course is actually taking (H is half term, Y if full year), can be different from the course length if the course is being offered at 0.5x speed or 2x speed
    • 20165: The term it was offered (20165 is 2016 Summer, aka year 2016, month 5 which is july)

This is unique to every course taught at all 3 campuses. Hopefully the website you're scraping from will give you bits and pieces that you can put together to form the full id. Let me know if you need clarification or help with anything!

Any yeah, breadths are a UTSG thing so UTSC might not apply. You can leave them as empty arrays.

qasim avatar Apr 14 '16 02:04 qasim

Thanks

vatdaell avatar Apr 14 '16 03:04 vatdaell