The (pseudo) causal chain

   http://zig.media.mit.edu/Work/G-stalt

In last entry, I considered why a gesture interface like G-stalt is studied in Tangible Media Group. Prof. Ishii says that:

Interfaces that control the computer with a mouse are like a black box, and it's difficult to understand what's going on inside. If gestures are used, however, one can clearly see the causal chain, as with a violinist's response to the conductor's baton. Research into gesture interfaces is attempting to hammer out a new paradigm by seamlessly merging body, objects, and space."

MIT Media Lab Tangible Media Group's Gesture Interfaces: Dynamic Interaction in Hybrid Space in AXIS 2009.8 vol.140

Although G-stalt seamlessly connects body, objects, and space, why the image is not in this relationship? The thing that is moved by the gestures is not the object itself but the image on the display, isn't it? Are 'body, objects, space and images' seamlessly merged in G-stalt? However, Prof. Ishii does not say the image. Why? Maybe, the images have already become the objects in our life. If we think that, I can smoothly connect the gesture interfaces with 'Radical Atoms' which is next vision of TMG. Now, we rarely think that the image is the 'image'. The image is something like the object, so it is tangible. Therefore, we can feel that the image is the object and the objects is the objects at the same time now. This idea makes totally new paradigm. This paradigm may be related with plasticity, I think. 

I want to focus on Prof. Ishii' word " If gestures are used, one can clearly see the causal chain". I consider that the mouse and the cursor on the display make "pseudo-cause-and-effect" between our action which is ruled by physical cause and effect and computer logic which is not ruled by one. Then, The pseudo-cause-and effect changes the images on the display into the 'object [entity]' which is something tangible. Even though the image which we see on the display has already become the 'object', it is supported by the pseudo-cause-and-effect. However, the gesture may interfaces remove  'pseudo' from the pseudo-cause-and-effect because the gesture is closely connected our body. Therefore, Prof. Ishii is maybe right. Our action will be tightly connected with the image on the display because the gesture is very close to our body. In the mouse and cursor, 'to grab and move something' is transformed into  'to point and move something' and this transformation makes the pseudo-cause-and-effect on the display. 'Grab' and 'point' are very general actions for us, then we can do many things with the combinations of these two actions on the display. As result, there is the ambiguous relationship between the image on the display and our action. However, the gesture requires one to one relationship with the image on the display. This one-to-one relationship make us think why an action is connected with the change of image on the display. Connecting our gesture with the image on the display in one to one relationship, the image may be more close to the object. Then, may the ambiguity of our action be reduced in turn?