yhcc

Bug in the flat-ner pre-processing

21

Hi, I found a bug in your pre-processing code. https://github.com/ShannonAI/mrc-for-flat-nested-ner/blob/a40c8b97cf081bbfcf845282012aad1012d7466f/data_preprocess/label_utils.py#L54 I think it should be ```python span_labels.append((start, len(sentence_tags) -1 , sentence_tags[-1].split("-")[-1])) ```` This bug will cause the number of entities...

### 📚 The doc issue https://github.com/hpcaitech/ColossalAI/blob/9c9246c0d9e09fc261ff9d052deb5ef1e02e614c/examples/language/gpt/requirements.txt#L3 感觉应该是4.23.1

[BUG]: False warning

1

### 🐛 Describe the bug The warning should be in the if condition? https://github.com/hpcaitech/ColossalAI/blob/8897b8f753a7908db7b9ff4519ef79dd4708ef97/colossalai/initialize.py#L304-L306 ### Environment _No response_

[BUG]: FusedScaleMaskSoftmax last dimension does not sum to 1

1

### 🐛 Describe the bug I use the following code to test the softmax, but the result does not sum to one ```python from colossalai import kernel import math import...

[BUG]: Maybe it is a bug in LowLevelZeroOptimizer

4

### 🐛 Describe the bug I am not sure whether the following code https://github.com/hpcaitech/ColossalAI/blob/48d33b1b1753f19361e7e54a68a7ac5999dc02e4/colossalai/zero/sharded_optim/low_level_optim.py#L484-L488 should be changed into ``` for group_id in range(self.num_param_groups): for rank in range(self._world_size): fp16_param = self._param_store.get_flat_fp16_param_by_rank_group(rank=rank,...