Sebastian Husch Lee

Results 69 issues of Sebastian Husch Lee

**Related Issue(s)**: Issue #2853 **Proposed changes**: - Updated `FARMReader.eval_on_file` to behave the same as `FARMReader.eval` by adding the options `use_no_answer_legacy_confidence` and `calibrate_conf_scores` ## Pre-flight checklist - [x] I have read...

type:bug
action:needs documentation
topic:eval
topic:reader
journey:advanced

**Describe the bug** This is not really a bug, but an investigation as to why the metrics reported for `deepset/roberta-base-squad2` on HuggingFace are not reproducible using the `FARMReader.eval_on_file` function in...

topic:accuracy
topic:eval
topic:reader

**Related Issue(s)**: [Issue #1512 ](https://github.com/deepset-ai/haystack/issues/1512) [Issue #1222](https://github.com/deepset-ai/haystack/issues/1222) **Proposed changes**: Migrating to Pytorch's native AMP https://pytorch.org/docs/stable/notes/amp_examples.html because it is much easier to use (no additional dependency on apex) and needs fewer...

action:needs documentation
topic:speed
breaking change

### Related Issues - addresses part of #2969. Namely the postprocessing of results and being able to handle long text documents without truncation. ### Proposed Changes: This PR updates a...

**Is your feature request related to a problem? Please describe.** We would like to add multiple test cases to make sure a problem with Hugging Face authorization tokens is recognized...

Contributions wanted!
topic:models
topic:tests

**Is your feature request related to a problem? Please describe.** I find the `embed_meta_fields` option of the `EmbeddingRetriever` to be extremely helpful in retrieving relevant results for large files that...

type:feature

**Is your feature request related to a problem? Please describe.** It can be very difficult for users to know what similarity functions (`cosine` or `dot_product`) are appropriate for a given...

type:feature
topic:retriever
P2

### Related Issues - fixes N/A, but related to bug fix in PR https://github.com/deepset-ai/haystack/pull/5223 in the sense that the bug was originally missed due to pipeline.eval tests not being run...

topic:pipeline
type:documentation
topic:tests

### Related Issues - fixes N/A ### Proposed Changes: - Added support for gradient_checkpointing for Sentence Transformers training. This can greatly reduce the memory usage on a GPU allowing for...

type:documentation
topic:tests
topic:retriever

### Related Issues - fixes #5354 ### Proposed Changes: Adds the option `embed_meta_fields` to the Ranker nodes using a similar implementation to the one used in EmbeddingRetrievers. ### How did...

type:documentation
topic:tests