In the Mixed Reality Project, by StopAntPlay and Rene Serrano, the visitor is filmed in real time and these 3D images are recreated in a 3D virtual world. Users can then choose among several models and interact with them in a mixed reality world using special glasses or a flexible screen.
The system is based on “trackers”, black and white marks to which the computer reacts via a video camera. The information acts as a code sent by the camera to the computer that in turn, generates virtual images to be superimposed on the video according to the position and movements of the tracker. Website is in spanish but they have a video of the application.
You can have a go at the Mixed Reality Project during the OFFF festival in Barcelona, on May 12-14.