konsti

Allow parsing from `std::io::Read`

2

Currently, simply reading a file to a `JsonValue` involves quite some boilerplate: ```rust let mut contents = String::new(); let mut file = File::open(some_path)?; file.read_to_string(&mut contents)?; let json = json::parse(&contents)?; ```...

Spam filter crashes the bot

1

I've been getting this error from the cron job for a couple of days: ``` Traceback (most recent call last): File "/home/utasart/github-wikidata-bot/.venv/lib/python3.8/site-packages/pywikibot/page/_decorators.py", line 29, in handle func(self, *args, **kwargs) File...

I just had to delete 240k files on the server because the cache apparently doesn't delete old files.

Version sorting: 2.5.1-2 isn't newer than 2.5.2

2

Currently, we're sorting the versions with the following code: ```python stable_releases.sort(key=lambda x: LooseVersion(re.sub(r"[^0-9.]", "", x.version))) ``` However this means that we're treating `2.5.1-2` as `2.5.12`. I wonder if we could...

Should we filter out 1970-01-01 as release date?

1

On the wikidata discussion, someone noted that we're adding 1970-01-01 as release date, breaking the oldest software demo. However this isn't the bot's fault, but the release date one github...

There is a number of projects that are skipped as their repository url isn't a real repository url. Some of those don't exist and should be deleted (such as votcacsg),...

This issue resulted from the discussion in #67. I currently see three cases: - [ ] If a url with the same host, same path (except for a trailing slash)...

Add protocol git to github urls

1

[source code repository (P1324)](https://www.wikidata.org/wiki/Property_talk:P1324) has a mandatory qualifier [protocol (P2700)](https://www.wikidata.org/wiki/Property:P2700), which is currently missing on most items. It should be added to the epository claim.

There are many projects with multiple repository urls ([wikidata query](https://query.wikidata.org/#PREFIX%20schema%3A%20%3Chttp%3A%2F%2Fschema.org%2F%3E%0A%0ASELECT%20%3Fproject%20%3FprojectLabel%20%3Farticle%20%3Frepo%20%28COUNT%28%3Fall_repos%29%20as%20%3Frepo_count%29%20WHERE%20%7B%0A%20%20%23%20Items%20with%20a%20repo%20on%20github%0A%20%20%3Fproject%20wdt%3AP1324%20%3Frepo.%0A%0A%20%20%23%20Exclude%20projects%20not%20hosted%20on%20github%0A%20%20FILTER%28contains%28STR%28%3Frepo%29%2C%20%22%3A%2F%2Fgithub.com%2F%22%29%29.%0A%20%20%0A%20%20%23%20Same%20as%20before%2C%20but%20without%20the%20filtering%2C%20so%20we%20can%20use%20it%20for%20counting%0A%20%20%3Fproject%20wdt%3AP1324%20%3Fall_repos.%0A%0A%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22en%22%20.%20%7D%0A%0A%20%20%23%20Get%20the%20corresponding%20wikipedia%20page%0A%20%20OPTIONAL%20%7B%0A%20%20%20%20%3Farticle%20schema%3Aabout%20%3Fproject%20.%0A%20%20%20%20%3Farticle%20schema%3AinLanguage%20%22en%22%20.%0A%20%20%20%20%3Farticle%20schema%3AisPartOf%20%3Chttps%3A%2F%2Fen.wikipedia.org%2F%3E%0A%20%20%7D%0A%7D%0AGROUP%20BY%20%3Fproject%20%3FprojectLabel%20%3Farticle%20%3Frepo%0AHAVING%20%28%3Frepo_count%20%3E%201%29%0AORDER%20BY%20%3FprojectLabel%0A), [file with query](https://github.com/konstin/github-wikidata-bot/blob/master/free_software_items_with_multiple_repos.rq)). If there is only one github repository url (and they are not raw and normalized), url normalization...

The following is the error log without the errors listed in #19 and those due to multiple repository urls. It should be investigated why those errors occur. ``` ERROR HTTP...