open-digger icon indicating copy to clipboard operation
open-digger copied to clipboard

How often does Open-digger compute and update?

Open Peng99999 opened this issue 3 years ago • 6 comments

Hi, we want to analyze some new metrics, such as the number of downloads of a release. This metric is time-sensitive, so we want to know how often Open-digger calculates and updates? Thanks.

Peng99999 avatar Oct 16 '22 07:10 Peng99999

Hello, I think you want to do some work such as calculating some metrics using sample data. Our sample data comes from gharchive.org. They collect all GitHub logs. If using sample data, your data is fixed within a period and not real-time updated. But in our central database, we will synchronize log data with a several-day delayed time(no more than 2 days I think)

xgdyp avatar Oct 16 '22 08:10 xgdyp

Thank you! If the log data is synchronized every two days, I think our work is feasible, because the number of downloads delayed for two days does not change much.

Peng99999 avatar Oct 16 '22 08:10 Peng99999

Actually the delay is only several hours, but the number of release downloads is not part of the events log, the count can be retrieved only by API with authorized token I think.

frank-zsy avatar Oct 16 '22 09:10 frank-zsy

In "open-digger/docs/assets/data_description.csv", line 123, does the field "release_assets.download_count" means the number of downloads for this release?

Peng99999 avatar Oct 17 '22 12:10 Peng99999

In "open-digger/docs/assets/data_description.csv", line 123, does the field "release_assets.download_count" means the number of downloads for this release?

Yes, but actually the events log only record on release create, that means the release_assets.download_count is always 0 in the log.

frank-zsy avatar Oct 18 '22 02:10 frank-zsy

Thank you for your answers! Thanks!

Peng99999 avatar Oct 20 '22 07:10 Peng99999

You are welcome, and you can use GitHub API to get the data you want. We also open source a simple GitHub GraphQL Node.js client to handle token and concurrency, feel free to use it https://github.com/X-lab2017/github-graphql-client.

I will close the issue for now and you can open issue if you have any other problem or feature request.

frank-zsy avatar Oct 21 '22 13:10 frank-zsy