Skip to content

facebookresearch/projectaria_tools

Project Aria Tools

Project Aria Tools is a suite of C++/Python utilities to help researchers expand the horizons of Augmented Reality, Machine Perception and Artificial Intelligence with Project Aria. It is designed to make it easier to use Aria data and its open datasets. It supports both Aria Gen1 and Aria Gen2 data.


πŸš€ What's New in Aria Gen2

Aria Gen2 introduces significant hardware and software improvements with full API support in this 2.0.0 release.

Hardware & Sensors

  • 12MP RGB camera, 4 CV cameras (wider FOV, HDR, front-facing stereo), 2 eye tracking cameras
  • New sensors: Proximity, contact microphone, PPG health, ambient light, GNSS
  • 6-8 hour battery life, foldable form factor, direct interactivity with open-air speakers

On-Device Machine Perception

On-device algorithms powered by a custom Meta co-processor:

  • Eye Tracking, Hand Tracking (21 keypoints), VIO/SLAM (20Hz + 800Hz high-freq trajectory)

Software & Tools

  • Unified APIs: Same Python/C++ interface for both Gen1 and Gen2 data
  • New Tools: aria_rerun_viewer (interactive 3D visualization), gen2_mp_csv_exporter, upgraded vrs_health_check
  • Enhanced Streaming: USB/wireless sensor streaming with on-device perception signals

πŸ“– Documentation

Aria Gen2 Documentation - NEW! ✨

  • Gen2 Documentation - Complete guide for Aria Gen2 data and tools
    • Research Tools APIs
    • Python/C++ examples
    • Data formats and specifications
    • On-device ML features

Aria Gen1 Documentation

Documentation Status


πŸ“š Interactive Python Tutorials (Google Colab)

Aria Gen2 Tutorials - NEW! ✨

Comprehensive tutorials covering Aria Gen2 data processing:

  1. Tutorial 1 VrsDataProvider Basics - how to perform basic operations in loading and access data in an Aria VRS file.

  2. Tutorial 2 Device Calibration - how to work with device calibration in Aria VRS.

  3. Tutorial 3 Sequential Multi-Sensor Access - how to use the unified queued API to efficiently β€œstream” multi-sensor data.

  4. Tutorial 4 Eye Tracking & Hand Tracking - how to work with on-device-generated EyeGaze and Hand-tracking signals from Aria Gen2 glasses.

  5. Tutorial 5 On-Device VIO - how to work with on-device-generated VIO data from Aria Gen2 glasses.

  6. Tutorial 6 Time Synchronization - understanding timestamp mapping in Aria data, and how to use timestamp mapping in multi-device recording.

  7. Tutorial 7 MPS (Machine Perception Services) - how to load and visualize output data from Aria MP services.

Aria Gen1 Tutorials

  • Aria VRS Data Provider Aria VRS Data Provider

  • Aria Machine Perception Services Reading and using Aria Machine Perception Services output (SLAM, Eye Tracking, Hand Tracking data)


πŸ—‚οΈ Open Datasets

Aria Gen2 Datasets

  • Aria Gen2 Pilot Dataset: Dataset link
    • Multi-participant indoor and outdoor recordings
    • Full on-device outputs (eye tracking, hand tracking, VIO)
    • SubGHz-synchronized multi-device captures
    • High-quality MPS outputs (SLAM, point clouds, trajectories)

Aria Gen1 Datasets


How to Contribute

We welcome contributions! Go to CONTRIBUTING and our CODE OF CONDUCT for how to get started.

License

Project Aria Tools are released by Meta under the Apache 2.0 license.