Julian Risch
Julian Risch
### Related Issues - fixes https://github.com/deepset-ai/haystack/issues/5333 ### Proposed Changes: We want to set up end-to-end tests and as a first step aim to re-enable the existing e2e workflow. ### ToDo:...
Get the outdated [e2e tests](https://github.com/deepset-ai/haystack/blob/main/.github/workflows/e2e.yml) running with just one quick test, nightly just as the nightly tutorial runs: https://github.com/deepset-ai/haystack-tutorials/blob/974aee41fc464cf3d7ccc76eb16f52e40462b242/.github/workflows/nightly.yml#L5 - Tests in e2e/document_stores/test_update_embeddings.py can be converted into multiple unit tests...
### ToDo: - Tests in e2e/modeling/test_adaptive_qa_inference.py can be removed and the asserts can be checked in a e2e test with a QAPipeline. - Tests in e2e/modeling/test_distillation.py can remain e2e tests,...
We run [unit tests and integration tests](https://github.com/deepset-ai/haystack/blob/main/.github/workflows/tests.yml) for Haystack but don't have end-to-end tests at the moment. [Nightly tutorial runs](https://github.com/deepset-ai/haystack-tutorials/blob/main/.github/workflows/nightly.yml) extend the current testing a bit. After adding [benchmarks in...
The goal is to increase the awareness and usage of Haystack (especially with pipelines v2) with neighboring communities and companies. ### Developer relations efforts ```[tasklist] ### Tasks - [ ]...
Test eval with tiny dataset, check dataframes, isolated, integrated eval (migrate existing integration tests to e2e tests)
Similar to nightly tutorial runs, we want to sent information about failed nightly e2e test runs for 2.x to Datadog: https://github.com/deepset-ai/haystack-tutorials/blob/974aee41fc464cf3d7ccc76eb16f52e40462b242/.github/workflows/nightly.yml#L76
We are working on Haystack 2.0, with a major refactoring of pipelines and components. ## Rationale We need to prioritize the list of components and separately the list of document...
- Get smoke tests from platform team and select subset for end-to-end tests - Get example pipeline from sol and other usage scenarios - Get Agent usage scenarios etc. from...
Select a subset of the currently unmarked, deactivated tests that can become e2e tests.