CoinCheung

Hi, I do not have that script, since I do not have much experience with that dataset.

Sorry that I do not have such script now, maybe I will add one in the future.

@JanuszL Thanks for replying !! I have one more question. If there are more than one tar files given to `webdataset` , how will dali shuffle the samples? Will the...

Hi @JanuszL , Just to make sure I have got your point. Does this mean that, different tar files are loaded sequentially, but within each tar file the samples are...

Thanks for telling me this!!! I have a suggestion, maybe at the beginning of each epoch we can shuffle the order of the tar files. After the order of tar...

I am closing this since my question is answered. I am sorry that I am not able to contribute now. Thanks again for your help to the community !!!

Hi @JanuszL , I got the reason. My platform has 1T memory, but the dataset size is 10T, and I assigned `read_ahead=True`, which is the cause of the long time....

本赛季初期洛杉矶湖人一度霸占西部战绩榜首，但是随着爵士太阳等队的崛起，加上两大核心巨星的先后受伤，湖人目前战绩已经跌到了西部第四，如果继续输球随时有可能跌出西部前八的可能。对此湖人阵容迎来了新变化，三届全明星跌出轮换，德拉蒙德迎首秀。今日来自记者Shams的信息，在德拉蒙德加盟湖人之后，一场比赛会征战30多分钟，而且会马上成为球队的首发中锋，而球队此前的首发中锋马克-加索尔不仅仅会成为替补，也很有可能掉出湖人轮换阵容。作为昔日NBA最优秀的内线球员之一，在灰熊效力时期的马克-加索尔，先后入选三次全明星阵容，还入过最佳阵容一阵，获得过最佳防守球员，是灰熊队攻守两端的真正核心。休赛季湖人一一份两年合同签下小加索尔，也成为了湖人球迷口中美妙的引援。但是本赛季开始至今，小加索尔已经彻底成了毒瘤一般的存在，只要小加索尔上场，湖人就会陷入被动。在全明星之前，湖人队给了他足够的上场时间去找状态，但是结果是非常遗憾的，小加索尔在场均上场20分钟的情况下，只贡献出4.8分+4.1篮板，不但攻不进守不住，就连曾经最擅长的一手策应也稀烂，场均只有2个助攻，还有1次失误，表现辣眼无比。随着德拉蒙德的到来，他将会和哈雷尔分配中锋位置的时间，小加索尔跌出轮换也是在情理之中。那么德拉蒙德何时能迎来湖人生涯的首秀呢？明天早上十点，湖人主场将对阵雄鹿，德拉蒙德将成为首发出战，但是对于很久没打比赛的他来说，需要几场比赛时间来找状态。

Will this problem be fixed by updating to newest version of transformers, or must we modify the config file manually each time?

Hi, Would you post your full error message? I do not have this problem.