vision-utils
vision-utils copied to clipboard
Scripts to convert 2D images and videos into Spatial versions
__ _(_)___(_) ___ _ __ _ _| |_(_) |___
\ \ / / / __| |/ _ \| '_ \ | | | | __| | / __|
\ V /| \__ \ | (_) | | | | | |_| | |_| | \__ \
\_/ |_|___/_|\___/|_| |_| \__,_|\__|_|_|___/
vision-utils
This repo contains various projects related to the Vision Pro & visionOS.
Content
- Convert a 2D Photo to Spatial Photo
- Convert a 2D Video to Spatial Video
- CLI to generate a stereoscopic image
- visionOS Icons
2D to Spatial Content
Convert any photos to spatial photos and videos viewable in the Apple Vision Pro! There is a mini swift cli executable that works on M1 apple computers to attach png files together.
See Photo Blog Post and Video Blog Post for more info.
Dependencies
We borrow the executable and iPhone args from Mike Swanson for converting over under videos to spatial videos.
We assume that you have poetry globally installed for python packaging and you're using Python 3.
cd spatialconverter
poetry install
poetry shell
# Poetry breaks when trying to install transformers from source, so run this installation the first time
pip install -q git+https://github.com/huggingface/transformers.git
Subsequent runs
cd spatialconverter/spatialconverter
poetry shell
python main.py --photo /Users/herk/Downloads/photo.png
# python main.py --video /Users/herk/Downloads/skydive.mp4