List of Flaky Tests

[mohammedri]

I'm going to log flaky tests in this ticket . They waste our time by having to rerun the pipeline.

• [ ] test_put_has_status_code_and_params
• [x] test_multiple_keys_with_at_most_singly_nested_values
• [ ] test_config_list_returns_empty_listing_when_root_missing
• [ ] test_foundations_create_syncable_directory_without_any_job_ids

[shazraz]

• [ ] test_can_load_parameters_as_empty_dict_within_foundations_submit_empty_params

[amackillop]

I think that I fixed test_multiple_keys_with_at_most_singly_nested_values

The bug was that since the keys of the dictionary paramete_input are generated using faker, every now and then the generated keys would collide and cause a previously defined key to be overwritten thus it would no longer appear in the expected output if it was of the non_empty keys that caused the override.

For example, this could happen:

>>> parameter_input = {'fake_word1': 1,
         'fake_word2: 2,
         'fake_word1: 3}
>>> paramet_input
    {'fake_word1: 3, fake_word2: 2}

I suspect that this could be happening with other flaky tests as well.