RayFronts: Open-Set Semantic Ray Frontiers for Online Scene Understanding and Exploration

RayFronts is a real-time semantic mapping system that enables fine-grained scene understanding both within and beyond the depth perception range allowing robots to localize and effectively limit search volumes. RayFronts can be queried with open-set images and text within the map and beyond it.