feat(variant index): improved data structure

[DSuveges]

✨ Context

Upon iterating on the variant page a number of points have been identified that can be improved. For more details see this comment

🛠 What does this PR implement

🙈 Missing

Purely business logic, there's no integration with airflow.

🚦 Before submitting

• [ ] Do these changes cover one single feature (one change at a time)?
• [ ] Did you read the contributor guideline?
• [ ] Did you make sure to update the documentation with your changes?
• [ ] Did you make sure there is no commented out code in this PR?
• [ ] Did you follow conventional commits standards in PR title and commit messages?
• [ ] Did you make sure the branch is up-to-date with the dev branch?
• [ ] Did you write any new necessary tests?
• [ ] Did you make sure the changes pass local tests (make test)?
• [ ] Did you make sure the changes pass pre-commit rules (e.g poetry run pre-commit run --all-files)?