While trying to figure out useful ways to interact with some wire frame models of 3D Harmonographs, I started exploring some examples of augmented reality software that allows a 3D mesh model to be tracked to a physical marker. The two pieces of software experimented with were the AR Plugin for Autodesk Showcase and LinceoRV. Both are stand-alone render/presentation engines with an augmented reality mode.
I found the Showcase AR Plugin to work well with pre-recorded footage, but not accept my live webcam feed, and LinceoRV to work much better with the live feed, but be more limited on the types of marker that it accepted. Both pieces of software can handle multiple markers.
The software basically analyses a binary [black and white] feed from the film, recognises the marker symbols, and works out their distortion due to perspective. It then uses this distortion to accurately recreate the camera position in relation to the digital model.
Using the LinceoRV software could be an useful way to present/manipulate 3D models that are too challenging/costly to print.