Augmented object intelligence with XR-Objects
The implementation of XR-Objects involves four steps: (1) detecting objects, (2) localizing and anchoring onto objects, (3) coupling each object with an MLLM for metadata retrieval, and (4) executing actions and displaying the output in response to user input. We use Unity and its AR Foundation to bring these together to build a system that […]