Loss Averaged acrosses the batches?

[i55code]

Hi Soumith,

A general question for all criterion class:

Is the loss averaged across the batches, and for seq2seq mini batch, does it average across the sequence length too?

Thank you!

Cheers, Zhong