Yi Zhou

Q0: 0.10.0 vs 1.0.0 Q1: I found a warn [WARN] [hivemind.optim.state_averager.load_state_from_peers:669] Failed to load state from peer, received inconsistent number of optimizer statistics Could this be the reason for fail...

I solved this! In example/albert The trainer peer used scheduler while monitor peer not. Which results in some differences in the "optimizer state_dict" of the two peers(scheduler will add a...

> 那如果是http的请求，设置samesite不生效，除了修改浏览器SameSite by default cookies 设置，还有什么办法么 nginx反向代理，跨域变同域试试

for me, both bfloat16 and float16 failed but float32 works btw @TobyYang7 's solution works