The research issues of this complex project conceptually decompose into three areas: its mathematical and algorithmic part, its system issues, and its application part.

Algorithmically, we need to develop (purchase where available) a suite of powerful mathematical routines and data structures for fast visualization, real-time collision detection (degree of separation, depth of penetration), position and orientation data filtering, interpolation and extrapolation of rotations, and for several auxiliary problems. On the system level, we need to tie together multiple computer processors, diverse and imperfect hardware peripheries, and several software modules - including those mentioned in the previous paragraph - with a human into one working system, no less complex than, for instance, a modern car. This system needs to be capable of performing art, manufacturing, engineering design, athletic training or other creative, entertaining, or useful activity better and easier then the human did alone before. This is the application part.