Ulrich Germann

Harmonize options between scorer and translator

1

Is there a specific reason why scorer and translator diverge in options? It would be nice to be able to run the scorer directly on a translator config file produced...

Status of MMAP blocks in src/translator/translator.h

10

What's the status of the `#if MMAP` blocks in src/translator/translator.h? Is that code working, and why are they disabled?

### Bug description project_version.h is created only when cmake is run for the first time but not updated when the VERSION file changes. ### How to reproduce ``` mkdir build...

Choose code path for use of CPU features at run time instead of at compile time

7

Following up on #559, it would be good to make use of CPU features for optimization when available at run time rather than at compile time, so that we can...

Marian won't compile on KNL processors

9

``` In file included from /usr/lib/gcc/x86_64-linux-gnu/5/include/immintrin.h:55:0, from /home/shared/germann/code/marian/88d9980/src/tensors/cpu/sharp/avx_gemm.cpp:2: /usr/lib/gcc/x86_64-linux-gnu/5/include/avx512bwintrin.h: In function ‘void marian::cpu::int16::{anonymous}::Convert32Sum(__m512i&)’: /usr/lib/gcc/x86_64-linux-gnu/5/include/avx512bwintrin.h:1192:1: error: inlining failed in call to always_inline ‘__m512i _mm512_madd_epi16(__m512i, __m512i)’: target specific option mismatch _mm512_madd_epi16 (__m512i...

Fail but don't abort on user error

3

Currently, I think we're a bit too trigger-happy on ABORT_IF. A simple user error (such as mistyping a command line option, or missing mandatory options) should not result in a...

Priority handling in the request queue

1

I've just [jotted down](https://github.com/browsermt/bergamot-translator/wiki/PriorityHandling) an idea on how to handle priorities in the request queue. I humbly think my suggestion is trivial to implement as a comparison operator between requests,...

Preemptable marian training on slurm.

3

These changes allow marian training jobs on slurm to be interrupted without losing training progress. The script requests an early warning from slurm a set amount of time (currently 300...

Backtranslations were broken. Currently re-running on alvis. Follow progress here: ``` /fs/surtr0/germann/firefox-translations-training-new/.snakemake/log/2022-03-21T144013.644988.snakemake.log ```

Looks like we're back to square 2 (data is cleaned) for nl-en, en-nl, pl-en, fr-en ... All trained models (post the backtranslation model) |translation direction|snakemake data dir|status| |--------------------------|--------------------------|--------| |nl-en |...