Development of a stereo vision mixed reality framework

[摘要] ENGLISH ABSTRACT:Augmented reality is a fairly young research field, still in an infancy stageat Stellenbosch University. Since this is one of the first augmented realityprojects, one goal is to present a theoretical study of augmented reality. Thisstudy is given in the literature study, along with a review of the availabledevelopment solutions.While there are various tools available with which one can create markerbasedaugmented reality applications, these tools are not meant for testing newtechniques and algorithms in an augmented or mixed reality. The remaininggoals of this project is to create a platform for the rapid design of augmentedreality applications, and to expand the capabilities of this platform beyondmarker-based augmented reality.In this project we present the design and implementation of a pragmaticmixed-reality framework capable of a wider variety of applications. A designis shown where marker tracking can be used alongside other computer visiontechniques to design new applications. The framework utilises stereo camerasto find the position of real world objects, and a 3D display to make the mixedreality environment as immersive as possible.Proof of concept test applications built with the framework are presented.Colour based techniques are used to find a user's hand and create a virtualrepresentation of it. This allows the user to interact with a virtual object inan augmented reality scene by 'touching' it with her hand.

[发布机构] Stellenbosch University