rerun-io
Can't load lerobot v3.0 datasets
Describe the bug After the LeRobot update to 0.4.0 and the dataset to v3.0, I can no longer use the drag-and-drop feature to visualize and inspect the dataset
To Reproduce Steps to reproduce the behavior: Simply drag a LeRobot v3.0 dataset to the Rerun GUI
Expected behavior A visualizer of the dataset will pop up
Backtrace
xxx:~/Desktop/workspace/policy_ws$ rerun
[2025-10-28T02:36:55Z INFO re_grpc_server] Listening for gRPC connections on 0.0.0.0:9876. Connect by running `rerun --connect rerun+http://127.0.0.1:9876/proxy`
[2025-10-28T02:36:55Z INFO winit::platform_impl::linux::x11::window] Guessed window scale factor: 2.5
[2025-10-28T02:36:55Z WARN wgpu_hal::vulkan::instance] Unable to find extension: VK_EXT_physical_device_drm
[2025-10-28T02:36:55Z WARN wgpu_hal::gles::egl] No config found!
[2025-10-28T02:36:55Z WARN wgpu_hal::gles::egl] EGL says it can present to the window but not natively
[2025-10-28T02:36:55Z WARN wgpu_hal::gles::adapter] Max vertex attribute stride unknown. Assuming it is 2048
[2025-10-28T02:36:55Z WARN wgpu_hal::gles::adapter] Max vertex attribute stride unknown. Assuming it is 2048
[2025-10-28T02:36:55Z INFO egui_wgpu] There were 3 available wgpu adapters: {backend: Vulkan, device_type: DiscreteGpu, name: "NVIDIA GeForce RTX 4070 Ti", driver: "NVIDIA", driver_info: "570.195.03", vendor: NVIDIA (0x10DE), device: 0x2782}, {backend: Vulkan, device_type: Cpu, name: "llvmpipe (LLVM 20.1.2, 256 bits)", driver: "llvmpipe", driver_info: "Mesa 25.0.7-0ubuntu0.24.04.2 (LLVM 20.1.2)", vendor: Mesa (0x10005)}, {backend: Gl, device_type: Other, name: "NVIDIA GeForce RTX 4070 Ti/PCIe/SSE2", driver_info: "3.3.0 NVIDIA 570.195.03", vendor: NVIDIA (0x10DE)}
[2025-10-28T02:37:04Z INFO re_data_loader::load_file] Loading "/home/xxx/Desktop/workspace/ros_ws/data/no_tactile/experiment_2025-10-14_20-33-38/experiment_2025-10-14_20-33-38_lerobot/train"…
[2025-10-28T02:37:04Z ERROR re_data_loader::load_file] Failed to load data from file path="/home/xxx/Desktop/workspace/ros_ws/data/no_tactile/experiment_2025-10-14_20-33-38/experiment_2025-10-14_20-33-38_lerobot/train" loader="rerun.data_loaders.Rrd" err=Failed to read: Is a directory (os error 21)
[2025-10-28T02:37:04Z ERROR re_data_loader::load_file] Failed to load data from file path="/home/xxx/Desktop/workspace/ros_ws/data/no_tactile/experiment_2025-10-14_20-33-38/experiment_2025-10-14_20-33-38_lerobot/train" loader="LeRobotDatasetLoader" err=Loading LeRobot dataset failed: missing field `total_videos` at line 166 column 1
Desktop (please complete the following information):
- OS: Ubuntu 24.04
Rerun version
rerun-cli 0.26.2 (base lance map_view nasm native_viewer oss_server re_server release_full release_no_web_viewer web_viewer) [rustc 1.88.0 (6b00bc388 2025-06-23), LLVM 20.1.5] x86_64-unknown-linux-gnu release-0.26.2 e3c279d, built 2025-10-27T10:38:18.139141282Z
Video features: av1 default ffmpeg nasm serde
Additional context I tested visualizing the v2.1 dataset, and it still works fine. I also tested training a model with the same dataset, both in v2.1 and v3.0 Lerobot versions, and I was able to reproduce the exact same loss curve, so I think the dataset itself should be fine.
I'm working on adding support for v3 datasets, should land shortly after #11849
