3060 12G GPU can run normally, but the speed is too slow. I hope it can be optimized.

[Crazy-CYZ]

Number of frames in a batch 3

[williamyang1991]

You can speed up the process by turning off some functions (sacrifice same performance)

modify https://github.com/williamyang1991/FRESCO/blob/9fe1be71b6c21890b5bc92659026f9586440266e/run_fresco.py#L232-L234 based on https://github.com/williamyang1991/FRESCO/blob/9fe1be71b6c21890b5bc92659026f9586440266e/run_fresco.py#L223-L225

[jinwyp]

On 3080ti the GPU usage is under 30%, most of time is only 1%

[jinwyp]

I have done some test list below on 3080ti :

This processing time is only for processing the time of the first 3 keyframes.

1. Default setting ===== time: 171.90519642829895 sec

2. Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt() ===== time: 47.287460803985596 sec

3. Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt() ===== time: 25.293941736221313 sec

Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt() Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt() ===== time: 15.881555318832397 sec

[williamyang1991]

My run_fresco.ipynb ran on 4090 GPU, the running time for 8 frames is

1. Default setting: 26s
2. Turn off all optimization: 3s

I have done some test list below on 3080ti :

This processing time is only for processing the time of the first 3 keyframes.

1. Default setting ===== time: 171.90519642829895 sec
2. Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt() ===== time: 47.287460803985596 sec
3. Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt() ===== time: 25.293941736221313 sec

Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt() Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt() ===== time: 15.881555318832397 sec