plugins.cakephp.org icon indicating copy to clipboard operation
plugins.cakephp.org copied to clipboard

[SHELL] Process Google Alerts for new repositories

Open josegonzalez opened this issue 13 years ago • 5 comments

At some point, I had a cron working that processed incoming google alerts to a given email address. It would be nice to bring this back.

  • Once an hour, a shell retrieves a Google Alert rss feed
  • Process the urls of each item in the list to retrieve the base url for the repository
    • This should throw out anything in a specific blacklist, like cakephp/cakephp
    • Throw out all non-repository urls. Maybe keep gist urls?
  • Match all repositories against existing repos. If they exist, throw out the item
  • Check to see if the repository is a fork. If so, throw it out
    • At some point, we may want to list forks, or at least have the option of making it the "mainline", especially for migrations to 2.0
  • Get a list of all branches, the repository name, and some stats
  • Insert the repos into a table for later processing
  • Send an email to the site admin with a list of all new potential repos

The email would have some general data about the packages, including the link to the repo, the description, and other stats collected, as well as a link to automatically approve the package on plugins.cakephp.org. We can use a token system so that logging in is not required for approving the package.

Thoughts?

josegonzalez avatar Apr 05 '12 02:04 josegonzalez

Sounds great and well planned out. I believe we can have the Google Alerts delivered to a public RSS feed as well. So we don't have to check an email address (unless you're already suggesting this in the first bullet).

shama avatar Apr 05 '12 07:04 shama

Once an hour, a shell retrieves a Google Alert rss feed

:)

josegonzalez avatar Apr 05 '12 14:04 josegonzalez

:thumbsup:

shama avatar Apr 05 '12 16:04 shama

Do you want to work on this next? Seems like an interesting project to work on, and potentially can be made into a plugin for opensource win. On Apr 5, 2012 12:15 PM, "Kyle Robinson Young" < [email protected]> wrote:

:thumbsup:


Reply to this email directly or view it on GitHub: https://github.com/cakephp/cakepackages/issues/50#issuecomment-4979921

josegonzalez avatar Apr 05 '12 16:04 josegonzalez

Yeah absolutely. I'll put it next on my todo list.

shama avatar Apr 05 '12 16:04 shama