ISAACS is an open-source project to envision new ways for human users to intuitively interface and collaborate with aerial drones around augmented reality (AR) technologies.
ISAACS utilizes real-time SLAM solutions to localize the 3D coordinates of aerial vehicles and the operators wearing HoloLens. The first version of the platform will be developed in collaboration also with DJI based on the Matrice-100 platform.
A new 3D, contextualized robot interface allows operators to control and command a drone fleet directly from HoloLens. It represents a new vision of how human-robot interface (HRI) can be, which can provide seamless and intuitive extension of human operators’ perception and control capabilities to a fleet of aerial vehicles in complex environments.
ISAACS also interfaces with drones' low-level controller to enhance the safety of the drone operation even in the case of human error. Carefully designed vehicle safety information will be also augmented in 3D space via HoloLens to enhance the operators’ situation awareness.
ISAACS is inspired by the famous game theorist Rufus Isaacs, who contributed to the fundamental development of the classic pursuit-evasion game theory and dynamic programming, among many other notable work. Here is a Wikipedia page dedicated to him: https://en.wikipedia.org/wiki/Rufus_Isaacs_(game_theorist)
Today, we’re excited to announce the award recipients of the Microsoft HoloLens Academic Research Grant Program. Earlier this year, we challenged academic institutions to submit their ideas to harness the potential of Microsoft HoloLens and push the boundaries of possible applications for holographic computing.