Falk Amelung

Feb 4 Hi Falk, 1) I had a conversation with our admins team. Your IO job is a big concern to them for a while. They have spent a lot...

Feb 5 Hi Falk, From my record, the last time our admins blocked you on Stampede2 because some of your jobs raised high IO requests with Python modules. 1) If...

Feb 10: Hi Falk, It is not about the test programs. It looks like you submitted so many runs again. Here is what I can see now. 7265480.bat+ batch tg-ear200+...

Feb 12 Background: one typical workflow consists of ~200 launcher tasks for steps 1-7 and ~1000 launcher tasks for steps 8-11. **1. Questions to address for uninterrupted runs::** - check...

March 30 Hi Falk, I just ran several short jobs in your launcher job file. Are those jobs are similar? From what I observed, all IO are on $SCRATCH. There...

The basic idea is to check whether the server (service) from which we download is online and whether downloading works. In many cases processing failures are the result of a...

Hi @mirzaees , for `--workDir` I verified that it works as suggested above: ``` timeout 0.01 ls $WEATHER_DIR/ERA5/ERA5_N20_N40_E60_E80_20150608_01.grb >> /dev/null ; echo $? 0 //login3/work/05861/tg851601/stampede2/insarlab/WEATHER/ERA5[1060] timeout 0.001 ls $WEATHER_DIR/ERA5/ERA5_N20_N40_E60_E80_20150608_01.grb >>...

I don't know which is an efficient way to check whether a download service is online. Here some commands that I would suggest for the first services (but a longer...

I am getting this one: You don't get this? May have to use a more specific address as in ssara_federated_query.bash Also possible that I have some credentials stored.

Not sure I understand. So checking for the ASF server does not work well? If there is no proper wget command we can download a file (and interrupt after 1...