LTP icon indicating copy to clipboard operation
LTP copied to clipboard

Why don't mask during Testing?

Open sev777 opened this issue 2 years ago • 0 comments

https://github.com/kssteven418/LTP/blob/f1d5ec88aba913de5e2b4aa502af9cf0ab7bb13f/src/transformers/models/ltp/modeling_ltp.py#L247

    if self.training and not self.hard_masking:
        if pruner_outputs is not None:
            threshold, pruning_scores = pruner_outputs['threshold'], pruner_outputs['scores']
            self.mask = torch.sigmoid((pruning_scores - threshold) / self.temperature)
            layer_output = layer_output * self.mask.unsqueeze(-1)

sev777 avatar Jan 19 '23 12:01 sev777