BatchNorm problem

[zzzmm1]

I tried to replace the backbone or bottleneck with other convolutional layers with BN and ReLU. The training result is good but the validation and testing results are very low. I have already set the network.eval() while testing. Will BN and ReLU affect the results of model training and testing? Should I change BN to LN, even after convolutional layers? Or it is possible to use only the convolutional layer without BN and RELU?