GAO WEI

Question about training epoch?

2

I have a question about the result of epoch. Why do you use 600-2000 epoch to validate the superiority of your method? I think that the epoch number is too...

What's the formulation of calculating flops?

1

Dear author, I am confused with the formulation of flops calculation, especially in your Paper Network Slimming Table 2. How do you derive that the flops of VGGA is 4.57*10^10?...

Vision Transformer cifar10 bug

7

### 🐛 Describe the bug When I run a [vit experiment](https://github.com/hpcaitech/ColossalAI-Examples/tree/main/image/vision_transformer/hybrid_parallel) by the following command ``` node=76 prefix="srun --nodes=1 --gres=gpu:4 --cpus-per-task=4 --ntasks=1 -w SG-IDC1-10-51-2-$node" $prefix colossalai run --nproc_per_node 4 train_with_cifar10.py...

Fail to run alpa test

2

**Please describe the bug** **Please describe the expected behavior** **System information and environment** - OS Platform and Distribution (e.g., Linux Ubuntu 16.04, docker):Linux Ubuntu 18.04, - Python version:3.9 - CUDA...

How to build and obtain specific version kafka docker images

1

I need a docker image `kafka:2.13-2.7.0`. The maintainer has deleted the docker hub account. I cannot access `kafka:2.13-2.7.0`. Anyone provides documentation to build a docker image to satisfy concrete version.

Streaming via ssh across clusters

2

## 🚀 Feature Request I want to use `streaming` to access a remote datacenter via ssh with certain privacy-related permission. ## Motivation I want to use a separate cluster to...

Multi-Node Sparse Training Error

3

Thanks for your releasing Ok-Topk. It is an interesting work, and I am developing certain functions based this repo. I succeed in single-node training. However, when I try Ok-Topk across...