SkyAR_Paddle_GUI

• A Paddle and GUI implementation of SkyAR.
• Base repo： jiupinjia/SkyAR
• Paper：Zhengxia Zou. Castle in the Sky: Dynamic Sky Replacement and Harmonization in Videos. CoRR, abs/2010.118003, 2020.

Examples

• raw video：

  

• jupiter：

  

• rainy：

  

• galaxy：

  

• district9ship：

  

• raw video：

  

• floatingcastle：

  

• thunderstorm：

  

• supermoon：

  

License

SkyAR by Zhengxia Zou is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

GUI

• This implementation has a simple GUI. You can easy to use this program.

  

GUI Executable Version

• GUI Executable file has been release：link

• It made by Pyinstaller, and only support the cpu with avx instruction set.

Quick Start

• clone or download the code

• download the pretrained model：link

• unpack the pretrained model into ./SkyAR

  -SkyAR  
    -ResNet50FCN  
      -__model__  
      -__params__  

• run main.py

$ python main.py -v [video_path] -s [save_path]

• or run GUI version

$ python GUI.py

Configs

optional arguments:
  -h, --help  show this help message and exit

  -m MODEL_PATH, --model_path MODEL_PATH
  -v VIDEO_PATH, --video_path VIDEO_PATH
  -s SAVE_PATH,  --save_path  SAVE_PATH
  -p PREVIEW_FRAMES_NUM, --preview_frames_num PREVIEW_FRAMES_NUM

  -c CONFIG, --config CONFIG
  All Choices：[
    'rainy', 'sunny', 'cloudy', 'galaxy', 'jupiter', 'sunset', 
    'supermoon', 'district9ship', 'floatingcastle', 'thunderstorm'
  ]

  Set custom skybox
  Please set --config to None if use custom skybox:
  --skybox_img SKYBOX_IMG
  --skybox_video SKYBOX_VIDEO
  --rain_cap_path RAIN_CAP_PATH

  --is_show              to visual result 
  --is_rainy             is rainy
  --is_video_sky         is video skybox

  More configs to tune the result:
  --disable_halo_effect  disable halo effect
  --auto_light_matching  is auto light matching
  --relighting_factor    RELIGHTING_FACTOR
  --recoloring_factor    RECOLORING_FACTOR
  --skybox_center_crop   SKYBOX_CENTER_CROP

Citation

@inproceedings{zou2020skyar,
    title={Castle in the Sky: Dynamic Sky Replacement and Harmonization in Videos},
    author={Zhengxia Zou},
    year={2020},
    journal={arXiv preprint arXiv:2010.11800},
}