renku icon indicating copy to clipboard operation
renku copied to clipboard

Accessing datasets project in nested groups

Open rollicks-c opened this issue 4 years ago • 2 comments

Bug description Datasets in renku projects, that are located in nested subgroups, cannot be accessed. The translations from the datset url https://renkulab.io/datasets/<dataset-id> to the knowledge graph url https://renkulab.io/knowledge-graph/projects/<project>/data is incorrect. The parent groups are ignored. Hence, the server replies with 500 - Error: Cannot access knowledge graph:...

Example project

  • dataset-url: https://renkulab.io/datasets/a02a2d55-9733-4ffe-9b65-feed9291bab9/
  • project-url: https://renkulab.io/projects/rchris-testbed/group-level1/group-level2/data-project

Steps to reproduce

  1. create nested groups in gitlab (projects/group1/group2)
  2. create a new renku project, template "minimal renku" in the created subgroup
  3. add a dataset
  4. lookup the dataset url (https://renkulab.io/datasets/
  5. within a renku project, try to import the dataset: renku dataset import https://renkulab.io/datasets/

Expected behavior The knowledge graph url is correctly resolved and the dataset is available in the current project afterwards.

Execution output Error: Cannot find these projects in the knowledge graph: https://renkulab.io/knowledge-graph/projects/group-level2/data-project Note: only the last (deepest nested) group shows up in the url.

Run environment

  • renkulab browser?
  • terminal
  • renku-python version: how? there is no renku --version command or is there?
  • browser: does not matter

rollicks-c avatar Nov 04 '20 19:11 rollicks-c

At least now, after the re-provisioning being started 6 days ago, the mentioned dataset with a02a2d55-9733-4ffe-9b65-feed9291bab9 id does not exist in the KG, yet (GET https://renkulab.io/knowledge-graph/datasets/a02a2d55-9733-4ffe-9b65-feed9291bab9 returns 404).

Similarly, the project is also not there in the KG yet (GET https://renkulab.io/knowledge-graph/projects/rchris-testbed/group-level1/group-level2/data-project returns 404).

I'd suggest waiting at least a few more days to look into that again. Alternatively, we could try to reproduce it on the DEV. From what I remember there was an issue on the renku-python which about nested groups but not sure if that's been solved. @Panaetius maybe?

jachro avatar Nov 11 '20 15:11 jachro

I think the issue with the nested groups was solved. I can import datasets from sub-groups like https://renkulab.io/projects/group1/group2/project

ksanao avatar Mar 26 '21 13:03 ksanao