EvTexture icon indicating copy to clipboard operation
EvTexture copied to clipboard

request for colab notebook

Open GeeveGeorge opened this issue 1 year ago • 10 comments

hope you guys setup a colab inference notebook where users can upload .mp4 and check the results.

GeeveGeorge avatar Jun 23 '24 04:06 GeeveGeorge

Thank you for your suggestion! Our model is an event-based VSR method that requires both video and event data as input as link, with event data can be generated using an event simulator. We plan to simplify this process and provide a convenient Colab notebook for inference on user-provided videos. Additionally, we aim to deploy our model on HuggingFace for easier future access.

DachunKai avatar Jun 23 '24 09:06 DachunKai

@GeeveGeorge Hi, GeeveGeorge. We noticed that runpod.io has already implemented a Colab notebook for testing our model. Thanks to runpod.io for this effort! We hope it helps you, but we haven't tested it yet. For user-provided videos, we are working on developing a simple system that allows users to upload their videos and receive super-resolved results. Thank you!

DachunKai avatar Jun 24 '24 17:06 DachunKai

@GeeveGeorge Hi, GeeveGeorge. We noticed that runpod.io has already implemented a Colab notebook for testing our model. Thanks to runpod.io for this effort! We hope it helps you, but we haven't tested it yet. For user-provided videos, we are working on developing a simple system that allows users to upload their videos and receive super-resolved results. Thank you!

tested. not working = (

FDFGGH avatar Jun 27 '24 17:06 FDFGGH

@FDFGGH jupyter try this:


!git clone https://github.com/camenduru/EvTexture
!mkdir -p /content/EvTexture/experiments/pretrained_models/EvTexture

!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_REDS_BIx4.pth -O /content/EvTexture/experiments/pretrained_models/EvTexture/EvTexture_REDS_BIx4.pth
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_Vimeo90K_BIx4.pth -O /content/EvTexture/experiments/pretrained_models/EvTexture/EvTexture_Vimeo90K_BIx4.pth
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_REDS4_h5.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/test_sets_REDS4_h5.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_Vid4_h5.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/test_sets_Vid4_h5.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/visual_results_EvTexture_REDS4_BIx4.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/visual_results_EvTexture_REDS4_BIx4.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/visual_results_EvTexture_Vid4_BIx4.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/visual_results_EvTexture_Vid4_BIx4.zip


%cd /content/EvTexture/experiments/pretrained_models/EvTexture
!unzip test_sets_Vid4_h5.zip
!mv /content/EvTexture/experiments/pretrained_models/EvTexture/Vid4_h5 /content/EvTexture/datasets/Vid4_h5

%cd /content/EvTexture/experiments/pretrained_models/EvTexture
!unzip test_sets_REDS4_h5.zip
!mv /content/EvTexture/experiments/pretrained_models/EvTexture/REDS4_h5 /content/EvTexture/datasets/REDS4_h5

%cd /content/EvTexture
!pip install .

%cd /content/EvTexture
!python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml

%cd /content/EvTexture
!python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml

0smboy avatar Jul 01 '24 15:07 0smboy

Testing ok on ubuntu:

#prepare pretrained_models dirs
cd /opt/
git clone https://github.com/camenduru/EvTexture
cd EvTexture
mkdir -p experiments/pretrained_models/EvTexture

#download model and data files
cd experiments/pretrained_models/EvTexture
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_REDS_BIx4.pth 
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_Vimeo90K_BIx4.pth 
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_REDS4_h5.zip
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_Vid4_h5.zip


# unzip datasets
unzip test_sets_Vid4_h5.zip
mv Vid4_h5 /opt/EvTexture/datasets/
unzip test_sets_REDS4_h5.zip
mv REDS4_h5 /opt/EvTexture/datasets/

#install dependencies
cd /op/EvTexture
pip install .

#run single gpu for Vid4
python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml
#run single gpu for REDS4
python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml

#run multi gpus for Vid4
python -m torch.distributed.run --nproc_per_node=8 --master_port=7860 basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml --launcher pytorch

#run multi gpus for REDS4
python -m torch.distributed.run --nproc_per_node=8 --master_port=7860 basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml --launcher pytorch

0smboy avatar Jul 01 '24 15:07 0smboy

@0smboy, I'm not much of a pro. I can't say I'm really familiar with command prompt. While testing this notebook I'm getting some errors and script stops. I can copy the output of what I'm encountering.

FDFGGH avatar Jul 01 '24 16:07 FDFGGH

Hi everyone. We've uploaded a Colab file for a quick test. Special thanks to @0smboy and the EvTexture-jupyter project.

DachunKai avatar Jul 02 '24 07:07 DachunKai

@DachunKai thanks. are there any instructions how to use it?

FDFGGH avatar Jul 03 '24 09:07 FDFGGH

@FDFGGH Maybe you can read this tutorial link to learn how to use Google Colab. Thanks.

DachunKai avatar Jul 03 '24 11:07 DachunKai

I (kind of) know how to use the Collab. How to feed video files into this exact notebook?

FDFGGH avatar Jul 03 '24 11:07 FDFGGH