While trying to figure out useful ways to interact with some wire frame models of 3D Harmonographs, I started exploring some examples of augmented reality software that allows a 3D mesh model to be tracked to a physical marker. The two pieces of software experimented with were the AR Plugin for Autodesk Showcase and LinceoRV. Both are stand-alone render/presentation engines with an augmented reality mode.
I found the Showcase AR Plugin to work well with pre-recorded footage, but not accept my live webcam feed, and LinceoRV to work much better with the live feed, but be more limited on the types of marker that it accepted. Both pieces of software can handle multiple markers.
The software basically analyses a binary [black and white] feed from the film, recognises the marker symbols, and works out their distortion due to perspective. It then uses this distortion to accurately recreate the camera position in relation to the digital model.
Using the LinceoRV software could be an useful way to present/manipulate 3D models that are too challenging/costly to print.
WeWantToLearn.net 
Hi Dan, that’s amazing congrats for working it out. Can it show a geometry while it is being drawn (i.e. like the way harmonograph draws the curve little by little)?
I haven’t found a way to do that in either of the programs that I’ve used. It works from a mesh, and can only load one mesh per marker. I’m sure there are film editing programs that can morph a video feed to achieve something like that, but I haven’t come across them yet. Let me know if you know any!
Dan
that is awesome!!!!! it looks like it’s being 3d tracked