About running time

[BinhuiXie]

Hi @shaofeifei11, excellent work!

Recently, we are replicating the results of S3DIS. However, we encountered some problems, that is, the training time is particularly long, the cpu occupies a lot (about 10000%) and the gpu occupies very little (411 MB). Below are some training logs.

https://github.com/shaofeifei11/SSDR-AL/blob/0379f0605dd3fddfb70f2d7a936895a4de463488/SSDR_AL_s3dis/run_sota_comparison.sh#L4C4-L4C4

Round 1 | ****EPOCH 29****
Round 1 | epoch=29 | Step 00000000 L_out=0.013 Acc=0.80 ---223667.80 ms/batch
Round 1 | epoch=29 | Step 00000001 L_out=0.005 Acc=0.79 ---453048.01 ms/batch
Round 1 | epoch=29 | Step 00000002 L_out=0.008 Acc=0.75 ---669608.97 ms/batch
Round 1 | epoch=29 | Step 00000003 L_out=0.013 Acc=0.80 ---876903.68 ms/batch
Round 1 | epoch=29 | Step 00000004 L_out=0.008 Acc=0.77 ---1070255.29 ms/batch
Round 1 | epoch=29 | Step 00000005 L_out=0.008 Acc=0.83 ---1282948.85 ms/batch
Round 1 | epoch=29 | Step 00000006 L_out=0.015 Acc=0.78 ---1494286.34 ms/batch
Round 1 | epoch=29 | Step 00000007 L_out=0.013 Acc=0.79 ---1693152.11 ms/batch
Round 1 | epoch=29 | Step 00000008 L_out=0.008 Acc=0.74 ---1923150.88 ms/batch
Round 1 | epoch=29 | Step 00000009 L_out=0.023 Acc=0.76 ---2166929.96 ms/batch
Round 1 | epoch=29 | Step 00000010 L_out=0.011 Acc=0.76 ---2397121.86 ms/batch
Round 1 | epoch=29 | Step 00000011 L_out=0.044 Acc=0.78 ---2606436.96 ms/batch
Round 1 | epoch=29 | Step 00000012 L_out=0.006 Acc=0.76 ---2818597.04 ms/batch
Round 1 | epoch=29 | Step 00000013 L_out=0.017 Acc=0.77 ---3033712.59 ms/batch
Round 1 | epoch=29 | Step 00000014 L_out=0.037 Acc=0.69 ---3249413.07 ms/batch
Round 1 | epoch=29, train costTime=3249.4138610363007, | total_activation_sum=92371
Round 1 | Best m_IoU is: 0.409, OA is: 0.767 | val costTime=516.4193761348724

https://github.com/shaofeifei11/SSDR-AL/blob/0379f0605dd3fddfb70f2d7a936895a4de463488/SSDR_AL_s3dis/run_sota_comparison.sh#L5C2-L5C2

Round 1 | ****EPOCH 0****
Round 1 | epoch=0 | Step 00000000 L_out=16.967 Acc=0.27 ---151265.58 ms/batch
Round 1 | epoch=0 | Step 00000001 L_out=17.872 Acc=0.37 ---326435.99 ms/batch
Round 1 | epoch=0 | Step 00000002 L_out=15.755 Acc=0.44 ---524193.11 ms/batch
Round 1 | epoch=0 | Step 00000003 L_out=14.913 Acc=0.48 ---722180.39 ms/batch
Round 1 | epoch=0 | Step 00000004 L_out=10.989 Acc=0.60 ---908576.70 ms/batch

Thanks in advance.