Kenneth Heafield comments

Results 290 comments of


                                            Kenneth Heafield

all shards must have the same size -- problem with 6GPUs but not with 5

I think we can do that second scatter/gather in parallel?

Training speed of Transformer-Big

Hijacking since I'm working on GPU server procurement in Edinburgh, is a 10-GPU server reasonable if we tell people to use 8 for a NCCL job and 2 for unrelated...

Training speed of Transformer-Big

@emjotde We're academics here. . . RTX 2080 Tis.

Multi-Feature Transformer

Paging @cmaroti. Unbabel is obliged to deliver factors by 1 November in https://marian-project.eu/. That doesn't necessarily mean merged into this repo but at least visible in a fork. They've already...

Why is the cross entropy calculated by marian-scorer negative？

log

Put your company logo on Marian website if you use Marian

Thanks @AndreasEisele!

Put your company logo on Marian website if you use Marian

So uh website?

Put your company logo on Marian website if you use Marian

Omniscien runs Marian

Put your company logo on Marian website if you use Marian

The university has signed an agreement with Intel to use their logo under conditions that I've shared with @snukky . Not a fully done deal yet, but soon.

Put your company logo on Marian website if you use Marian

I've added Intel to the jekyll. @snukky can you check and deploy?