maintenance?

[costa]

This project looks unmaintained for over 3 years, and I'm not sure about the state of its code.

Now I'm looking for a simple job queue system — the bigger project involves accounting & security aspects and worker image / runtime management with K8s (no hope for a better match in R community) — and this is the only one I've found. However, I will not integrate an unmaintained package in a production project.

Any help will be appreciated, thank you.

[dfalster]

Hi @costa, Yes, you are right, the project has not been maintained. @richfitz was the main architect here and may be able to comment. @richfitz - do you know of any working implementations under active maintenance?

[costa]

Ok, I will try and evaluate it for integration still (I'm a software guy helping a bunch of scientists with their research environment).

[richfitz]

Most of the ideas live on in https://github.com/mrc-ide/rrq which works well for us and will likely get a bit of attention in Q4 this year

[costa]

@richfitz thank you for your work, i've just made rrqueue work with @pzingg's fork (and discontinued ropensci/RedisAPI), now can you outline the current shortcomings of mrc-ide/rrq as compared to this?

I'm currently trying to get a grasp on the state of affairs with mrc-ide components in an effort to bring the most viable R(esearch) environment up for the users back at my company.

I've also asked the organiser of the next Bristol meetup to try and set web conference up or to have it recorded at least.

[richfitz]

RedisAPI is deprecated with the functionality directly incorporated into the redux package. That should be used instead.

rrq implements most features in rrqueue but despite writing both I could not tell you what is and isn't there. Some of the bits that were in rrqueue are implemented in auxillary packages that rrq uses (e.g., creating the computational environment remotely, shipping out dependencies, etc)

[costa]

@richfitz Thank you! I believe you will be seeing my feedback in the respective repos.

[dfalster]

Cool @costa. I want to get rrqueue working here so followed your suggestion to use @pzingg's fork BUT - I couldn't get one of the dependencies (https://github.com/richfitz/heartbeatr) to install, so never succeeded in installing rrqueue. Did you encounter similar at any point?

Presuming can get this working, wondering if we should port changes from https://github.com/pzingg/rrqueue over to this repo so that still works?

[dfalster]

@richfitz - I'm trying to finish off our successional diversity project, which used rrqueue.

[richfitz]

xref: #31

[costa]

@dfalster this is the relevant excerpt from my Dockerfile:

RUN apt-get update -qq && apt-get install -y \
  libxml2-dev \
  libhiredis-dev
RUN Rscript -e "install.packages(c('RcppRedis', 'R6', 'digest', 'docopt', 'devtools')); devtools::install_github(c('ropensci/RedisAPI', 'richfitz/redux', 'costa/heartbeatr@old-rrqueue', 'richfitz/ids')); devtools::install_github('traitecoevo/rrqueue')"

It used to work short time ago.

[dfalster]

Thanks