KIT-ILIAS-downloader icon indicating copy to clipboard operation
KIT-ILIAS-downloader copied to clipboard

Published 20 hours ago • verified publisher icon FliegendeWurst

Add crawler for KIT websites like IPD

Open probstlukas opened this issue 3 years ago • 2 comments

Many KIT lectures do not use ILIAS to make the files available to students. Instead, they use the websites of their institutes. A prominent example is "Programmierparadigmen" with https://pp.ipd.kit.edu/lehre/WS202122/paradigmen/ and https://pp.ipd.kit.edu/lehre/WS202122/paradigmen/uebung/ (for the current semester). It would be practical to be able to set this up in a config file and obtain all files via the KIT-ILIAS downloader.

probstlukas avatar Oct 28 '21 19:10 probstlukas

In addition a crawler for the lecture recording platform of the KIT library would be nice.

funnym0nk3y avatar Oct 29 '21 10:10 funnym0nk3y

@thelukasprobst From "normal" websites that don't hide the download link behind some PHP or JS I can recommend browser extensions like DownThemAll or DownloadStar. This does not sync the files constantly but is useful for archiving the files. Also: Have a look at PFERD, which has this capability already.

The download of videos from KIT library (DIVA) works with youtube-dl via RSS ingestion. Usually lecture series are grouped and a RSS feed can be downloaded via

grafik

Shove that xml file into youtube-dl and voilà.

funnym0nk3y avatar Jan 06 '22 21:01 funnym0nk3y