Augmented and Virtual Reality

About the Augmented and Virtual Reality Node

Our vision is to study and produce enabling technology for mobile AR/VR to become a primary way to interact with and access complex data sources using the internet. As examples we envisage a future in which head-worn devices can be used to visualise the effect of global warming; sort through complex medical databases in novel yet intuitive ways; support medical training scenarios and teleproctoring. Research areas include: The ability of Network Operators to deliver/broadcast immersive and interactive (real-time) AR/VR via the network; Natural user interaction and enabling technologies to support ianteractions among multiple persons in AR/VR; and coordinating human-human interaction at remote sites and integrating into a centralised virtual environment.

Recent Projects

Big Data Demonstrator

“Big Data” is a popular term used to describe the fact that modern society has made huge investments in gathering and analysing data and that these data-driven activities are making the information technology industry one of the fastest-growing sectors of the world economy. It has been estimated that more data has been generated in the past two years than in the entire history of the human race. Large-scale visualisation systems… more

Natural User Interaction

In both demonstrator projects, we will focus on issues related to natural user interaction. Human focused analysis aims to continuously monitor the current status of users involved, including body movement, gestures, and expressions. Based on our existing expertise, we will develop enabling techniques to support natural interactions among multiple persons in a virtual/augmented environment, such as speaker identification, 3D audio based speaker localisation, human action recognition, and facial expression recognition.… more

Network Operations

In the demonstrator projects, we will explore the ability of Network Operators to deliver/broadcast immersive and interactive (real-time) AR/VR via the network. Recent marked advances in computer graphics and display technologies have enabled rapid growth in locally-operated AR/VR, i.e., AR/VR in which everything is computed and generated locally without requiring internet access. While these locally-operated AR/VR applications facilitate immersive and realistic experience with various types of real-world data, current technologies… more

Remote Environment Demonstrator

This demonstrator is championed by Rafael Calvo and builds upon the Stanford Ocean Acidification study by researchers at the Virtual Human Interaction Lab (VHIL) at Stanford University. Australia is the guardian of the Great Barrier Reef ecosystem. Human activity is causing CO2 levels to rise and this is causing acidification of our oceans. Most Australians do not have first-hand experience diving among the coral and sea animals that will eventually… more


A/Prof Craig Jin

Electrical & Information Engineering

Sensor technologies
craig.jin at sydney.edu.au

A/Prof Masahiro Takatsuka

Information Technologies

Novel user interfaces and interaction, visualisation
masa.takatsuka at sydney.edu.au


Prof Rafael A Calvo
Prof Judy Kay
A/Prof Jinman Kim
Prof Philip Leong
A/Prof Alistair McEwan