Download


MPL Dataset Toolbox


Since the data sequences are provided in individual rosbag files given their large size, we provide an additional, easy-to-use toolbox to guide this downloading process. The most used functions are listed below:

  • Event Visualizer: transform raw event stream into accumulated event frames.
  • Data Validator: validate the downloaded rosbag or the merged rosbag for its completeness.
  • Bag Merger: merge multiple, single-topic rosbags chronologically into one complete rosbag.
  • [NEW 2022-05] k4a Projector: reproject depth readings into other sensor frames.


Data Format


We provide all data sequences in two different formats (rosbag files and text files) with identical content. All rosbag files are compressed in bz2 format, and can be easily decompressed by using the bag merger function in MPL dataset toolbox.

  • /prophesee/left/events (prophesee_event_msgs/EventArray): Events from the left event camera.
  • /prophesee/right/events (prophesee_event_msgs/EventArray): Events from the right event camera.
  • /camera/left/image_mono (sensor_msgs/Image): Grayscale images from the left regular camera.
  • /camera/right/image_mono (sensor_msgs/Image): Grayscale images from the right regular camera.
  • /kinect/depth_image (sensor_msgs/Image): Depth images from the RGB-D sensor.
  • /ouster/point_cloud (sensor_msgs/PointCloud2): Point clouds from the LiDAR.
  • /imu/data (sensor_msgs/Imu): Full 9-axis readings from the IMU.
  • /gt/pose (geometry_msgs/PoseStamped): Ground truth signals.

  • left_event.hdf5 (DSEC format): Events from the left event camera stored in hdf5 format.
  • right_event.hdf5 (DSEC format): Events from the right event camera stored in hdf5 format.
  • left_camera.zip: Grayscale images with their exposure time from the left regular camera.
  • right_camera.zip: Grayscale images with their exposure time from the right regular camera.
  • kinect_depth.zip: Depth images from the RGB-D sensor.
  • lidar.zip: Point clouds from the LiDAR.
  • imu.txt: Full 9-axis readings from the IMU.
  • gt.txt (TUM format): Alternative ground truth signals for quantitative evaluation.


Disclaimer on the Depth Stream


  • The unit of the depth intensity is in millimeters from the origin of the camera.
  • Dropped frames are to be expected, owing to the singularity of the depth calculation in the k4a driver. We have deliberately left a blank on the depth stream to maintain the overall correctness.


Small-scale Data Sequences


board-slow
  • left event:   rosbag (159M)   |   hdf5 (112M)
  • right event:   rosbag (177M)   |   hdf5 (124M)
  • left camera:   rosbag (420M)   |   zip (435M)
  • right camera:   rosbag (410M)   |   zip (425M)
  • depth:   rosbag (61M)   |   zip (79M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • corner-slow
  • left event:   rosbag (143M)   |   hdf5 (104M)
  • right event:   rosbag (152M)   |   hdf5 (114M)
  • left camera:   rosbag (614M)   |   zip (583M)
  • right camera:   rosbag (595M)   |   zip (565M)
  • depth:   rosbag (140M)   |   zip (185M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • robot-normal
  • left event:   rosbag (131M)   |   hdf5 (95M)
  • right event:   rosbag (141M)   |   hdf5 (102M)
  • left camera:   rosbag (555M)   |   zip (541M)
  • right camera:   rosbag (542M)   |   zip (531M)
  • depth:   rosbag (118M)   |   zip (155M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • robot-fast
  • left event:   rosbag (392M)   |   hdf5 (244M)
  • right event:   rosbag (409M)   |   hdf5 (254M)
  • left camera:   rosbag (406M)   |   zip (396M)
  • right camera:   rosbag (400M)   |   zip (391M)
  • depth:   rosbag (90M)   |   zip (119M)
  • imu:   rosbag (1M)   |   txt (2M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • desk-normal
  • left event:   rosbag (131M)   |   hdf5 (95M)
  • right event:   rosbag (141M)   |   hdf5 (102M)
  • left camera:   rosbag (555M)   |   zip (541M)
  • right camera:   rosbag (542M)   |   zip (531M)
  • depth:   rosbag (118M)   |   zip (155M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • desk-fast
  • left event:   rosbag (1.23G)   |   hdf5 (725M)
  • right event:   rosbag (1.25G)   |   hdf5 (735M)
  • left camera:   rosbag (583M)   |   zip (577M)
  • right camera:   rosbag (574M)   |   zip (569M)
  • depth:   rosbag (159M)   |   zip (207M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • sofa-normal
  • left event:   rosbag (892M)   |   hdf5 (573M)
  • right event:   rosbag (979M)   |   hdf5 (623M)
  • left camera:   rosbag (1.31G)   |   zip (1.26G)
  • right camera:   rosbag (1.27G)   |   zip (1.21G)
  • depth:   rosbag (322M)   |   zip (419M)
  • imu:   rosbag (1M)   |   txt (2M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • sofa-fast
  • left event:   rosbag (689M)   |   hdf5 (407M)
  • right event:   rosbag (740M)   |   hdf5 (436M)
  • left camera:   rosbag (573M)   |   zip (546M)
  • right camera:   rosbag (561M)   |   zip (534M)
  • depth:   rosbag (147M)   |   zip (193M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • mountain-normal
  • left event:   rosbag (1.13G)   |   hdf5 (682M)
  • right event:   rosbag (1.19G)   |   hdf5 (718M)
  • left camera:   rosbag (846M)   |   zip (867M)
  • right camera:   rosbag (822M)   |   zip (858M)
  • depth:   rosbag (234M)   |   zip (295M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • mountain-fast
  • left event:   rosbag (1.86G)   |   hdf5 (1.02G)
  • right event:   rosbag (1.98G)   |   hdf5 (1.08G)
  • left camera:   rosbag (574M)   |   zip (632M)
  • right camera:   rosbag (568M)   |   zip (588M)
  • depth:   rosbag (146M)   |   zip (202M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • hdr-normal
  • left event:   rosbag (708M)   |   hdf5 (436M)
  • right event:   rosbag (732M)   |   hdf5 (457M)
  • left camera:   rosbag (1.02G)   |   zip (1.00G)
  • right camera:   rosbag (1.03G)   |   zip (1.01G)
  • depth:   rosbag (228M)   |   zip (284M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • hdr-fast
  • left event:   rosbag (1.50G)   |   hdf5 (855M)
  • right event:   rosbag (1.59G)   |   hdf5 (912M)
  • left camera:   rosbag (779M)   |   zip (763M)
  • right camera:   rosbag (768M)   |   zip (752M)
  • depth:   rosbag (140M)   |   zip (190M)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)
  • scene image:   jpg (2M)

  • Large-scale Data Sequences


    corridors-dolly
  • left event:   rosbag (294M)   |   hdf5 (217M)
  • right event:   rosbag (320M)   |   hdf5 (225M)
  • left camera:   rosbag (1.27G)   |   zip (1.20G)
  • right camera:   rosbag (1.27G)   |   zip (1.20G)
  • lidar:   rosbag (3.84G)   |   zip (4.72G)
  • imu:   rosbag (1M)   |   txt (2M)
  • ground truth:   rosbag (1M)   |   txt (1M)

  • corridors-walk
  • left event:   rosbag (423M)   |   hdf5 (292M)
  • right event:   rosbag (455M)   |   hdf5 (317M)
  • left camera:   rosbag (1.32G)   |   zip (1.25G)
  • right camera:   rosbag (1.31G)   |   zip (1.23G)
  • lidar:   rosbag (3.91G)   |   zip (4.82G)
  • imu:   rosbag (1M)   |   txt (2M)
  • ground truth:   rosbag (1M)   |   txt (1M)

  • units-dolly
  • left event:   rosbag (1.00G)   |   hdf5 (683M)
  • right event:   rosbag (1.03G)   |   hdf5 (712M)
  • left camera:   rosbag (2.62G)   |   zip (2.49G)
  • right camera:   rosbag (2.61G)   |   zip (2.47G)
  • lidar:   rosbag (8.32G)   |   zip (10.12G)
  • imu:   rosbag (2M)   |   txt (4M)
  • ground truth:   rosbag (1M)   |   txt (1M)

  • units-scooter
  • left event:   rosbag (874M)   |   hdf5 (566M)
  • right event:   rosbag (924M)   |   hdf5 (605M)
  • left camera:   rosbag (1.34G)   |   zip (1.28G)
  • right camera:   rosbag (1.32G)   |   zip (1.25G)
  • lidar:   rosbag (4.37G)   |   zip (5.30G)
  • imu:   rosbag (1M)   |   txt (2M)
  • ground truth:   rosbag (1M)   |   txt (1M)

  • school-dolly
  • left event:   rosbag (842M)   |   hdf5 (540M)
  • right event:   rosbag (904M)   |   hdf5 (583M)
  • left camera:   rosbag (1.57G)   |   zip (1.54G)
  • right camera:   rosbag (1.55G)   |   zip (1.52G)
  • lidar:   rosbag (4.44G)   |   zip (5.48G)
  • imu:   rosbag (1M)   |   txt (3M)
  • ground truth:   rosbag (1M)   |   txt (1M)

  • school-scooter
  • left event:   rosbag (531M)   |   hdf5 (328M)
  • right event:   rosbag (566M)   |   hdf5 (349M)
  • left camera:   rosbag (629M)   |   zip (613M)
  • right camera:   rosbag (621M)   |   zip (607M)
  • lidar:   rosbag (1.76G)   |   zip (2.17G)
  • imu:   rosbag (1M)   |   txt (1M)
  • ground truth:   rosbag (1M)   |   txt (1M)