An apparatus,
system and method controls and interacts within an interaction volume within a height over the coordinate plane of a computer such as a computer screen,
interactive whiteboard, horizontal interaction surface, video / web-conference
system, document camera, rear-
projection screen,
digital signage surface,
television screen or gaming device, to provide pointing, hovering, selecting, tapping, gesturing, scaling, drawing, writing and erasing, using one or more interacting objects, for example, fingers, hands, feet, and other objects, for example, pens, brushes, wipers and even more specialized tools. The apparatus and method be used together with, or even be integrated into, data projectors of all types and its fixtures / stands, and used together with flat screens to render display systems interactive. The apparatus has a
single camera covering the interaction volume from either a very
short distance or from a larger distance to determine the lateral positions and to capture the
pose of the interacting object(s).