Michael Schubert

Reuse common data

1

If I set up workers with multiple subsequent computations, it would be nice to only re-send constant/exported data if it actually changes. Something like: ``` Running 21,010 calculations (5 objs/348.8...

cf. https://github.com/ropensci/drake/issues/933 The underlying problem is that can not add/remove arbitrary objects to worker environments, or the environments themselves. This should be added to the worker API

Make `ssh` work on Windows

9

If possible. This could use the Linux subsystem in newer versions (Win>=10 IIRC) *Update:* Powershell now includes SSH by default (or needs to be activated?) on Win10 https://github.com/PowerShell/openssh-portable https://poweruser.blog/enabling-the-hidden-openssh-server-in-windows-10-fall-creators-update-1709-and-why-its-great-51c9d06db8df

Currently, there is no security mechanism to check if the incoming connections are actually from the submitted jobs, and not from a user that is trying to read out data...

From discussion in https://github.com/ropensci/drake/issues/813: The SLURM templates understand memory limits in Mb or Gb, e.g. by supplying "5G" or "128M". `ulimit` does not understand that, however. Probably should parse those...

Compilation fails for glibc=2.25, gcc=7.3.0

5

I'm getting the following error compiling `gpuR` on Gentoo Prefix using up-to-date `gcc` (`7.3.0`), `glibc` (`2.25`), and `R` (`3.4.4`) with `Rcpp` (`0.12.16`) package: ```r In file included from prefix/usr/lib/gcc/x86_64-pc-linux-gnu/7.3.0/include/g++-v7/cstdlib:75:0, #...

Improve socket options

1

* Remove `ZeroMQ= 3 * Replace redundant option setting functions by `setSockOptChr` and `setSockOptInt` * Expose high water mark option for `ZeroMQ>=3` using `set.send.hwm` and `set.rcv.hwm` * Include TCP keep-alive...

Variable lookup within indexing is broken

1

This is with the current git `master`. Consider the following example file (borrowed from the open PR): ```r library(rhdf5) f = h5createFile("ex_hdf5file.h5") B = array(seq(0.1,2.0,by=0.1),dim=c(5,4)) h5write(B, "ex_hdf5file.h5","B") h5closeAll() ``` Subsetting...

Consider the following example: ```r fname = "/path/to/my.gctx" file = rhdf5::H5Fopen(fname) data = file&"/0/DATA/0/matrix" data[1, 1:5] # works, but coerces the matrix to a vector data[1, 1:5, drop=FALSE] # Error:...

Possible integer parsing issue

1

I just ran into a potential issue with integer parsing, when combing reading and writing of the `yaml` R package with other packages/languages. According to the [yaml integer specification](https://yaml.org/type/int.html): >...