Stochastic optimisation methods and pattern search algorithms for augmented reality videoconferencing

Affordable and reliable virtual and augmented reality systems are making the step from the lab to our everyday lives. How will such systems influence the way we communicate at work and in private? How can we move away from screen based videoconferencing and achieve full co-presence, even when the users are on different continents? This dissertation introduces a novel system for collaborative telepresence based on the mutual integration of two users’ surroundings into a Consensus Reality. Other than in classical videoconferences or immersive telepresence systems, there is no separation between the users’ environments. Instead, the users have the impression of standing in their own room and see their conversation partner rendered through a head mounted display, as if they shared the same physical space. This text not only introduces the theoretical foundations of the Consensus Reality, but also provides a focussed examination of the integration of disparate remote spaces. In addition, there are practical suggestions to follow when designing a Consensus Reality videoconferencing system.