EasyNMT icon indicating copy to clipboard operation
EasyNMT copied to clipboard

How to run test_translation_speed.py

Open JohnWinner opened this issue 3 years ago • 2 comments

easynmt docker install is working fine through http requests. Now i'd like to run some benchmark. How do you run /examples/test_translation_speed.py ?

JohnWinner avatar Sep 08 '22 18:09 JohnWinner

To answer my own question...

docker exec -it easynmt bash
apt install wget
wget -O test_translation_speed.py https://raw.githubusercontent.com/UKPLab/EasyNMT/main/examples/test_translation_speed.py
python ~/test_translation_speed.py opus-mt

For the record I get the following result: 74.41 sentences/second

Machine spec: Intel i5-10400, 2.9 Ghz, 6 cores 32GB RAM HD: 512GB NVMe GPU: Geforce RTX 3070 Ti XC3 Ultra (8GB GDDR6)

JohnWinner avatar Sep 08 '22 20:09 JohnWinner

On my older server I get: ~49 sentences/second

Machine specs: Intel Xeon E5-2620 v3 Hex Core 2.40 GHz, 15M cache, 6 cores 32GB RAM HD: 2 x 250GB SSD (RAID 1) GPU: NVIDIA GeForce RTX 2080 Ti

JohnWinner avatar Sep 08 '22 21:09 JohnWinner