Jiarui Fang（方佳瑞）

Using MR #41 The launching script is as follows. ``` env OMP_NUM_THREADS=12 torchrun --standalone --nproc_per_node=4 train.py --from_torch --config=configs/palm_8b_zero_2p5d_badcase.py ``` It failed after a few iterations. I prefer to attribute the...

能否简单说明一下排序原理。 我看到的是把用户字典的结果排在固态字典之前。 但是怎么实现长句子放在短句子前的呢？是否用了词频信息呢？

basic query example

1

Hi, I try to follow the basic query example. After I launch the python script. ` python example_client.py ` I met the following problem. ` 20-10-10:10:49:22 WARNING [decorators.py:34] [default-cluster] Clipper...

Currently, the model path and http config is hard coded in files. Make the model path and the HTTP config can be passed via docker environmental variables.

[BUG]: LazyInitContext can not initialize huggingface GPT model

1

### 🐛 Describe the bug I use LazyInitContext to initialize a GPT model and then call ctx.lazy_init_parameters to initialize the model. I encounter an assert error. So, right now, the...

``` import torch import torch.nn as nn from colossalai.gemini.memory_tracer import MemtracerWrapper import colossalai colossalai.launch_from_torch(config={}) rank = torch.distributed.get_rank() model = nn.Sequential(*[nn.Linear(2000, 2000) for _ in range(20)]) model = MemtracerWrapper(model) input =...

This PR makes Gemini work for resnet18. It is not ready. I am still working on it.