- Path confidence
- 0.91
- Slope
- −11.5°
- Clearance
- 1.6 m
- Obstacle
- 2.9 m
- Frame
- 01100 · 30 fps
- Camera
- Perception
- Safe path
- Direction
A phone that finds the walkable path.
Harvard researchers built Mobilio, a navigation app that runs entirely on a smartphone. A custom computer-vision model reads the live camera feed from a pedestrian's point of view and finds walkable paths, blends in GPS, motion sensors and the phone's LiDAR where present, and guides blind and low-vision users with spatial audio cues.
Rendered scene. The trail above is drawn to show how a walkable-path model reads terrain. It is not source footage and not the app's real interface.
In a 14-person study it cut indoor obstacle contacts by about 41% compared with a cane and Google Maps. No new hardware. The phone in your pocket.