PreSumm icon indicating copy to clipboard operation
PreSumm copied to clipboard

A question about data_loader.py

Open elevenofji opened this issue 5 years ago • 1 comments

In the "create_batches" of class DataIterator


for buffer in self.batch_buffer(data, self.batch_size * 300):


why 300? I do think the second para should be self.batch_size * self.args.max_pos, otherwise the definition of args.max_pos is in contradiction with the 300

elevenofji avatar Jul 17 '20 09:07 elevenofji

In the "create_batches" of class DataIterator

for buffer in self.batch_buffer(data, self.batch_size * 300):

why 300? I do think the second para should be self.batch_size * self.args.max_pos, otherwise the definition of args.max_pos is in contradiction with the 300

Same problem here. It's not clear where that 300 comes from. Any explanation would be very helpful!

@nlpyang

pretidav avatar Oct 28 '22 15:10 pretidav