reframe

reframe copied to clipboard

Hello, ReFrame generated child pipelines do not have any extra CLI options at the moment. For example, when a pipeline fails, the users do not get an awful lot of...

mahendrapaipuri

Hello, Currently, the child pipelines generation of ReFrame has limited or no configurability. For example, the generated pipelines do not have `image` keyword which result in failed pipelines when any...

mahendrapaipuri

ReFrame crashed when it queried a `REQUEUED` job with Slurm

3

Here is the stack trace: ``` [2021-05-19T17:07:34] debug2: reframe: [CMD] 'sacct -S 2021-05-19 -P -j 31334100,31334101,31334102,31334103,31334106,31334109,31334110,31334112,31334114,31334116,31334118,3133411 9,31334120,31334121,31334122,31334123,31334124,31334125,31334126,31334127,31334128,31334131,31334132,31334133,31334134,31334135,31334136,31334139,31334142,31334143,31334145,31334 147,31334148,31334149,31334150,31334155,31334156,31334157,31334158,31334163,31334164,31334165,31334167,31334172,31334173,31334174,31334175,31334180,31334181,31334182,31334183,313 34188,31334189,31334190,31334191,31334196,31334197,31334198,31334199,31334204,31334205,31334206,31334207,31334212,31334213,31334214,31334215 -o jobid,state,exitcode,end,nodelist' [2021-05-19T17:07:34] debug2: reframe: [CMD] 'squeue -h -j 31334100 -o...

vkarak

Too many open files

8

I hit: `OSError: [Errno 24] Too many open files` when running lots of, quite short, tests. Total tests: 1326, each of about 30 seconds. I'm doing pairwise network tests on...

branfosj

vkarak

Consider using the Rich library for colouring and formatting ReFrame's output

1

The [library](https://github.com/willmcgugan/rich) seems quite interesting!

vkarak

Support a dry-run mode in ReFrame

3

This mode can simply emit job scripts without executing them.

mahendrapaipuri

Deprecate `perf_patterns`

1

These will be deprecated in favour of the ~~`@sanity_function`,~~ `@performance_function` and `perf_variables`. This is a major disruption. It also requires #2082.

vkarak

Keeping a test system busy, new execution policy?

8

I would like to extend reframe for the use case of generating a constant workload on a test/ warm spare system. ``` ./reframe -C my_config.py --tag workload1 -r --exec-policy=continuous --queue-depth=10...

brandongc

Adding support for more schedulers and parallel launchers is a recurring issue, so it'd be helpful if we document explicitly the corresponding API, as well as how ReFrame uses that...

vkarak