bigbang
bigbang copied to clipboard
datactive
Scientific analysis of collaborative communities
Should close https://github.com/datactive/bigbang/issues/446
Adding a named entity recognition method with huggingface. Adding an example notebook on how to use the recognizer with emails and visualize the recognized entities.
3GPP scraping suddenly stopped with the displayed message being: ``` 3GPP_TSG_SA_WG2: 47%|###############8 | 34805/74692 [21:51:29
Something is quite wrong with the IETF data collection procees. ``` $ python bin/collect_mail.py -u https://www.ietf.org/mail-archive/text/dns-security/ ['2008-05.mail', '2008-06.mail', '2008-07.mail', '2008-08.mail', '2008-09.mail', '2008-10.mail', '2008-11.mail', '2008-12.mail'] ``` So far so good, but...
Implement Graph Mining notebook based on algorithm in Mining Homophilic Groups of Users using Edge Attributed Node Embedding, by Priyanka Sinha, Ritu Patel, Pabitra Mitra, Dilys Thomas, Lipika Dey, presented...
We have some archaic plotting code in the notebooks. Here's an example: ``` plt.figure(figsize=(12.5, 7.5)) for i, activity in enumerate(acts): colors = 'rgbkm' ta = activity.sum(1) rmta = ta.rolling(window).mean() rmtadna...
At the IETF 110 HRPC meeting, there's an expressed interest in IETF membership/attendance, with respect to: - Are new people are joining ? (Organizational health) - Are they being retained?...
We have a standard way of configuring a path for email archives: it's the `mail_path` value in the config file. This is used by the mail collecting scripts. It is...
``` $ python bin/collect_mail.py -u https://mm.icann.org/pipermail/cc-humanrights/ Traceback (most recent call last): File "/usr/lib/python3.9/urllib/request.py", line 1346, in do_open h.request(req.get_method(), req.selector, req.data, headers, File "/usr/lib/python3.9/http/client.py", line 1253, in request self._send_request(method, url, body,...