video2numpy

video2numpy copied to clipboard

test out other video decoding backends

1

[pyAV](https://github.com/PyAV-Org/PyAV) - untested [VPF](https://github.com/NVIDIA/VideoProcessingFramework) - untested [decord](https://github.com/dmlc/decord): initial testing showed no clear performance advantage over video2numpy

iejMac

in particular https://github.com/iejMac/clip-video-encode

rom1504

Any way to integrate this within a pytorch dataloader/dataset?

9

Hello, is there any easy way to use the frame extraction method within the dataset/dataloader for pytorch? My understanding that it is not trivial given the use of multiprocessing here:...

TheShadow29

this is an important feature of this lib. N frames/s on hardware X is more useful than just "optimized"

rom1504

Begin of audio2numpy

1

A place holder pull request

YuchenHui22314

Performance Benchmarks for video decoding backends

6

iejMac

currently we only do intra-video batching but for short videos this leads to 1 padded batch. Should be a way to batch a few videos into one batch and split...

iejMac

iejMac

batch_size option for longer videos + live streams

1

iejMac

like here - https://github.com/rom1504/img2dataset/blob/main/img2dataset/resizer.py#L81

iejMac