Suggestion: "<org>/*" for the repo name

[sminnee]

Sometimes it will be helpful to pull in all repositories of a github organisation.

For this purposes it would be good to support "/*" as a repo name. You would want to be able to combine it with other repos so that for example you could configure the repo list as: silverstripe/* symbiote/silverstripe-advancedworkflow

I would imagine that this could be implemented as a preprocessor that expanded such entries on the repo list before commencing. At the same time as implementing this, a de-duplication filter might also be of use.

[luandy64]

Would having a stream that hits this endpoint be the same as what you are describing?

[sminnee]

Sort of. We need to hit that endpoint, and then use the results to adjust the value of repos before this for loop:

https://github.com/singer-io/tap-github/blob/master/tap_github.py#L481

Simply adding that endpoint as a stream wouldn't get the issues, pull requests, commits, etc, for each of those repositories.

[louisguitton]

that would be awesome 👏

[osterman]

Hello from Cloud Posse! We are large open source maintainers. We have over 300 projects on GitHub (all actively maintained) that we manage and would like to do a better job handling the metrics. This tap is almost perfect as-is, but we cannot easily manage this config with so many repos, so a wildcard would be desired.

[tinydylan]

My suggestion in #74 is basically a duplicate of this.