mapillary
mapillary_tools failed to process Blackvue videos, unrecognized gps?
Basic information
- mapillary_tools Release version:
0.11.1 - Desktop Uploader version
4.04 - Desktop Uploader Beta
4.1.8 - System:
Linux, Pop!OS - Capture Device:
Blackvue 900x
Steps to reproduce behavior
- run
mapillary_tools video_process_and_uploadfor a video file. (see console messages, last section of this ticket) - process stops, and report that "empty GPS found"
- after the error, I tried the Desktop Uploader and the file was uploaded without issues
Expected behavior
CLI should work if Desktop Uploader (DU) can upload the videos without errors.
After the CLI error, I tried the Desktop Uploader and the same file(s) were successfully uploaded using the DU 4.04
I also tried other files with DU Beta 4.1.8, and it also worked without errors.
Actual behavior
Command line processing and upload doesn't work. The upload was successful using the DU, and it appeared in my upload list as being "ingested", after a day the sequence disappeared from my upload list.
I thought I'd try again, but this time DU refused to upload the files, reporting that they've already been uploaded:
. However, I can't find it from my uploads.
Corresponding data
- videos - I have some examples (temporarily) available here. Let me know if I need to re-upload copies.
- SatNav track - While mapillary_tools report it couldn't find the GPS track, I was able to use exiftool to extract the tracks. Temporary copies are here.
mapillary_tools console messages
$ mapillary_tools video_process_and_upload ./temp/20231111_080922_NF.mp4 frames/ --video_sample_distance 0.5 --interpolate_directions --filetypes raw_blackvue --skip_process_errors --user_name "gowin" 2023-11-19 09:34:50,971 - INFO - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams temp/20231111_080922_NF.mp4 [mov,mp4,m4a,3gp,3g2,mj2 @ 0x55a0525f8c80] Found duplicated MOOV Atom. Skipped it Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'temp/20231111_080922_NF.mp4': Metadata: creation_time : 2023-11-11T00:10:23.000000Z major_brand : mp42 minor_version : 1 compatible_brands: mp42mp42 Duration: 00:01:00.98, start: 0.000000, bitrate: 25810 kb/s Stream #0:0(eng): Video: hevc (Main) (hvc1 / 0x31637668), yuvj420p(pc, bt709), 3840x2160, 25172 kb/s, 29.99 fps, 30 tbr, 1k tbn, 1k tbc (default) Metadata: creation_time : 2023-11-11T00:10:23.000000Z handler_name : PittaSoft Video Media Handler vendor_id : [0][0][0][0] Stream #0:1(eng): Audio: mp3 (.mp3 / 0x33706D2E), 11025 Hz, mono, fltp, 16 kb/s (default) Metadata: creation_time : 2023-11-11T00:10:23.000000Z handler_name : PittaSoft Sound Media Handler vendor_id : [0][0][0][0] 2023-11-19 09:34:51,081 - INFO - Extracting video metdata 2023-11-19 09:34:51,084 - WARNING - Empty GPS data found 2023-11-19 09:34:51,084 - WARNING - Force the option "filetypes" to be "image" to avoid processing and uploading both the video samples and the videos themselves Validating metadatas: 0metadata [00:00, ?metadata/s] 2023-11-19 09:34:51,108 - INFO - Checking upload status for 0 metadatas 2023-11-19 09:34:51,401 - INFO - Uploading to organization: {"slug": "mapamore", "description": "#Nowhere2KnowWhere", "name": "MapAmore", "id": "839022377015250"} 2023-11-19 09:34:51,405 - INFO - Nothing uploaded. Bye.
As a workaround, I've had some success processing and uploading the files if I extract the track with exiftool first:
$ exiftool -ext mp4 -n -ee -api LargeFileSupport=1 -X temp/ > /tmp/exiftool_output.xml
$ mapillary_tools video_process temp/ frames/ --geotag_source exiftool --geotag_source_path /tmp/exiftool_output.xml --video_sample_distance -1 --video_sample_interval 0.5 --overwrite_all_EXIF_tags --num_processes 2 --skip_process_errors --rerun
$ mapillary_tools upload frames
Hey @govvin the link to the sample video is expired. Could you try again?
The exiftool approach looks good to me.
This is likely an issue fixed in https://github.com/mapillary/mapillary_tools/releases/tag/v0.14.0a1