Our Mission

The Center for Augmented Cognition supports Berkeley faculty and students in their research on new computing paradigms and methodologies of human cognition modeling, human-computer interaction, and human-robot collaboration through augmented and virtual reality technologies.

Our Members

All Localization Imaging Immersion Interaction Applications Business Arts+Design Graphics
  • Ruzena Bajcsy

    Department of EECS, UC Berkeley

  • Francesco Borrelli

    Associate Professor
    Department of Mechanical Engineering,
    UC Berkeley

  • Luisa Caldas

    Department of Architecture,
    UC Berkeley

  • Lee Flemming

    Department of Industrial Engineering
    UC Berkeley

  • Richard Koci Hernandez

    Assistant Professor
    Journalism, UC Berkeley

  • Shannon Jackson

    Associate Vice Chancellor
    Arts and Design, UC Berkeley

  • Yi Ma

    Professor in Residence
    Department of EECS, UC Berkeley

  • Jack McCauley

    Oculus Co-founder
    Jacobs Institute for Innovative Design

  • Ren Ng

    Assistant Professor
    Department of EECS, UC Berkeley
    Lytro Founder

  • James O'Brien

    Department of EECS, UC Berkeley
    ACM SIGGRAPH Director at Large

  • S. Shankar Sastry

    Dean of the College of Engineering
    Professor of EECS

  • Claire J. Tomlin

    Department of EECS, UC Berkeley

  • Allen Y. Yang

    Executive Director
    Center for Augmented Cognition
    Department of EECS, UC Berkeley

Our Projects


ISAACS is an open-source project to envision new ways for human users to intuitively interface and collaborate with aerial drones around augmented reality (AR) technologies.

ISAACS utilizes real-time SLAM solutions to localize the 3D coordinates of aerial vehicles and the operators wearing HoloLens. The first version of the platform will be developed in collaboration also with DJI based on the Matrice-100 platform.

Learn More

AR/VR Design Experience

The AR/VR Design Experience track in the EECS Master of Engineering program creates a multi-disciplinary curriculum that offers students a comprehensive education and research experience in the emerging field of Augmented Reality and Virtual Reality.

Learn More


This research group is interested in computer vision, robotics, tele-immersive communications, and modeling of cyber-physical systems.

Our ongoing research activities entail human-robot cooperation, human activity recognition from multi-modal data, development of individualized musculoskeletal models, quantification of human performance, remote monitoring in health care and its privacy and security considerations, and modeling of driver interaction in semi-autonomous vehicles. Tele-immersion group is lead by Prof. Ruzena Bajcsy. The lab located in Sutardja Dai Hall, Room #133.

Learn More

Open Augmented Reality Kit (OpenARK)

OpenARK is an open-source wearable augmented reality (AR) system founded at UC Berkeley in 2016. The C++ based software offers innovative core functionalities to power a wide range of off-the-shelf AR components, including see-through glasses, depth cameras, and IMUs. The open-source platform includes fundamental tools such as AR-based camera calibration and SLAM, and it also includes higher-level functions to aid human-computer interaction, such as 3D gesture recognition and multi-user collaboration. We welcome interested industry partners to join our alliance to support the Open ARK platform.

Our Partners

Recent Updates

Berkeley AR/VR startup competition

Congratulations to the Pengram Team
for winning 1st place in this competition!

Pengram facilitates remote instruction of technical experts to technicians with complicated operations so as to enhance productivity and efficiency in enterprise collaboration. It displays intuitive operation instructions in the form of overlay holograms on real world machines through the Hololens. Technical experts can easily create a detailed live instruction animation without any coding in VR. For technicians, Pengram bridges the abysmal gap between the ambiguous traditional 2D paper based instructions and real world operation sequences.

Contact us

For more information and collaboration opportunities, please contact Executive Director Dr. Allen Y. Yang