II. The NEUROGES Coding System
4. The Aims and the Development of the NEUROGES Coding System
4.5 Development of the modules, categories, and values, and of the hierarchythe hierarchy
4.5.4 The hierarchy of the modules and categories
The three modules have been ordered in a hierarchy that constitutes the seven step coding algorithm. The categories are ordered from simple and compre-hensive to complex and specialized.
In Step 1 all six parts of the body, the right hand/arm, the left hand/arm, the right foot/leg, the left foot/leg, the head, and the trunk are coded. With only three criteria, i.e., motion, anti-gravity position, and muscle contraction, the movement behaviour is segmented into two Activation values ((i) movement, (ii) rest position / posture). In contrast, in Step 7 mainly hand/arm gestures are left to be assessed. Many criteria are employed to define the values: the criteria of the Activation, Structure, Focus, Contact, and Formal Relation categories, and in addition, the criteria gesture/action space, path during complex phase, orienta-tion, hand shape, efforts, body involvement, gaze, and - as a meta-criterion - cognitive perspective.
At each step (which represents a category), the units of the previous step are reassessed and the new criteria are added, and, if necessary, the units are seg-mented into subunits. Thereby, the seven step comprising segmentation and coding of movement behaviour leads to more and more fine-grained units and more and more complex values. Accordingly, NEUROGES codings look like an inverted tree. However, it is noteworthy that while the seven categories are ordered hierarchically in a decision process, each category functions on its own and - with some limitations - can be assessed independently of the others.
Given their simplicity, the Module I value definitions can be used for kine-matographic investigations and for automatized movement recognition tech-niques. To further improve the compatibility with kinematographic and auto-matized methods, in this module the right and left limbs are coded independ-ently of each other.
Module II constitutes a bridge between Module I and Module III, as it clari-fies the relation between the two limbs, which in Module I have been assessed independently of each other. The Module II codings determine whether in Module III the function is assessed for both hands (feet) together, e.g. both hands together pantomime drumming, or whether it is assessed separately for the right hand (foot) and for the left hand (foot), e.g. one hand scratches the leg while the other hand points to an external location.
Module III analyses the function of limb, head, and trunk movements.
Based on the Module I and Module II codings, at the stage of Module III when the assessment of complex phenomena such as the function of the movement is required, fine behavioural units are provided that are based on objective move-ment criteria.
References
Bartolo, A., Cubelli, R., Della Sala, S., Drei, S., & Marchetti, C. (2001). Double Dissociation between Meaningful and Meaningless Gesture Reproduction in Apraxia. Cortex, 37, 696-9.
Beattie, G. & Shovelton, H. (2006). When size really matters: how a single se-mantic feature is represented in the speech and gesture modalities. Gesture 6, 63-84.
Birdwhistell, R.L. (1970). Kinesics and Context. Essays on Body Motion Com-munication. Philadelphia: University of Pennsylvania Press.
Blonder, L.X., Burns, A.F., Bowers, D., Moore, R.W., & Heilman, K.M. (1995).
Spontaneous Gestures Following Right Hemisphere Infarct. Neuropsychologia, 33(2), 203-213.
Casanto D, & Dijkstra K. (2010) Motor Action and Emotional Memory. Cogni-tion, 115(1), 179-185.
Charny, E.J. (1966). Psychosomatic manifestations of rapport in psychotherapy.
Psychosomatic Medicine, 29 (4), 305-15.
Cubelli, R., Marchetti, C., Boscolo, G., & Della Sala, S. (2000). Cognition in Action: Testing a Model of Limb Apraxia. Brain and Cognition, 44, 144-65.
Darwin, C.R. (1890, reissue 2009). The Expression of the Emotions in Man and Animals (2nd ed.). London: Penguin Group.
Davis, M. (1991, rev. 1997). Guide to movement analysis methods. Pittsburgh, PA. USA.: Behavioral Measurement Database Services, P.O. Box 11028.
Dell, C. (1979). A primer for movement description using effort-shape and sup-plementary concepts. New York: Dance Notation Bureau Press.
Duffy, R.J., & Duffy, J.R. (1989). An investigation of body part as object (BPO) responses in normal and brain-damaged adults. Brain and Cognition, 10, 220-236.
Dumont, C., Ska, B.,& Schiavetto, A. (1999). Selective impairment of transitive gestures: An unusual case of transitive gestures. Neurocase, 5, 447-58.
Efron, D. (1941, 2nd ed. 1972). Gesture and culture. The Hague: Mouton.
Ekman, P., & Friesen, W. (1969). The Repertoire of Nonverbal Behaviour:
Categories, Origins, Usage and Coding. Semiotica, 1, 49-99.
Ekman, P., Friesen, W., & Hager, J.C. (2002). Facial Action Coding System.
The Manual. Salt Lake City, A Human Face.
Förster, J., & Strack, F. (1996). Influence of overt head movements on memory for valenced words: a case of conceptual-motor compatibility. Journal of per-sonality and social psychology 71(3), 421-30.
Foundas, A.L., Macauley, B.L., Raymer, A.M., Mahler, L.M., Heilman, K.M.,
& Rothi L.J.G. (1995). Gesture laterality in aphasic and apraxic stroke patients.
Brain and Cognition 29: 204-213.
Freedman, N. (1972). The Analysis of Movement Behavior During the Clinical Interview. In A. W. Siegman, B. Pope (Ed.), Studies in Dyadic Communication (pp. 153-175). New York: Pergamon.
Freedman N., & Hoffman S.P. (1967). Kinetic Behaviour in Altered Clinical States: Approach to Objective Analysis of Motor Behaviour during Clinical In-terviews. Perceptual Motor Skills, 24, 527-539.
Freedman, N., & Bucci, W. (1981). On kinetic filtering in associative mono-logue. Semiotica, 34(3/4), 225-249.
Haaland, K.Y., & Flaherty, D. (1984). The Different Types of Limb Apraxia Errors made by Patients with Left vs. Right Hemispehre Damage. Brain and Cognition, 3, 370 - 384.
Hall, E.T. (1966). The Hidden Dimension. New York: Doubleday.
Hartje, W., & Poeck, K. (2002). Klinische Neuropsychologie. Stuttgart: Georg Thieme Verlag.
Heath, M., Roy, E.A., Black, S.E., & Westwood, D.A. Intransitive Limb Ges-tures and Apraxia Following Unilateral Stroke. Journal of Clinical and Experi-mental Neuropsychology, 23, 628-42.
Heilman, K.M., Rothi, L.J.G. (1993). Apraxia. In K. M. Heilman, & Valenstein, E. (Ed.), Clinical Neuropsychology (pp. 141-164). New York, Oxford: Oxford University Press.
Hermsdörfer, J., Mai, N., Spatt, J., Marquardt, C., Veltkamp, R., & Goldenberg, G. (1996). Kinematic analysis of movement imitation in apraxia. Brain, 119, 1575-1586.
Hubbard, A., Callan, D., & Dapretto, M. (2006). How the Brain Sees What we say: an fMRI Study of Speech and Beat Gestures. Presented at the 12th Annual Meeting of the Organization for Human Brain Mapping, Florence.
Johnson, H.G, Ekman, P., & Friesen, W.V. (1975). Communicative body movements: American emblems. Semiotica 15, 335-353.
Kendon, A. (1972). Some relationships between body motion and speech. In A.
Siegman and B. Pope (eds). Studies in dyadic communication, 177-210, Perga-mon Press, New York.
Kendon, A. (2002). Some uses of the head shake. Gesture, 2(2), 147-182.
Kendon, A. (2010). Gesture - Visible Action as Utterance. : Cambridge Univer-sity Press.
Kita, S., & Lausberg, H. (2008). Generation of co-speech gestures based on spa-tial imagery from the right-hemisphere: evidence from split-brain patients. Cor-tex, 44, 131-139.
Kita, S., & Özyürek, A. (1999). Espressing manner and path in English and Turkish: differences in speech, gesture, and conceptualization. Paper presented at the 21st Annual Conference of the Cognitive Science Society London.
Krout, M.(1935). Autistic gestures. Psychological Monographs 46.
Kryger, M. (2010). Bewegungsverhalten von Patient und Therapeut in als gut und schlecht erlebten Therapiesitzungen. Diploma Thesis. Dept. of Neurology, Psychosomatic Medicine, and Psychiatry; Institute of health promotion and clinical movement science. Cologne, German Sport University.
Laban, R. (1988). The Mastery of Movement, Neuauflage. Worcester: Northcote House.
Lausberg, H. (1998). Does Movement Behavior Have Differential Diagnostic Potential? American Journal of Dance Therapy 20(2), 85-99.
Lausberg, H, & Kita S. (2003).The content of the message influences the hand choice in co-speech gestures and in gesturing without speaking. Brain and Lan-guage, 86, 57-69.
Lausberg, H., & Cruz, R.F. (2004). Hemispheric specialization for imitation of hand-head positions and finger configurations: a controlled study in patients with complete callosotomy. Neuropsychologia, 42, 320-334.
Lausberg, H., & Sloetjes, H. (2009). Coding gestural behavior with the NEUROGES-ELAN system. Behavioral Research Methods, 41(3), 841-849.
Lausberg, H., Davis, M., & Rothenhäusler, A. (2000). Hemispheric specializa-tion in spontaneous gesticulaspecializa-tion in a patient with callosal disonnecspecializa-tion.
Neuropsychologia, 38, 1654-1663.
Lausberg, H., v. Arnim, A., & Joraschky, P. (2007). Bewegungsanalyse in der Körperbild- und Körperschemadiagnostik. In G. H. P. Geißler (Ed.), Lebensbe-wegungen. Zum körperlichen Geschehen in der psychoanalytischen Therapie.
Ein Lehrbuch (pp. 165-196). Wien: Springer Verlag.
Lausberg, H., Kita, S., Zaidel, E., & Ptito, A. (2003). Split-brain patients neglect left personal space during right-handed gestures. Neuropsychologia 41, 1317-1329.
Lausberg, H., Zaidel, E., Cruz, R.F., & Ptito, A. (2007). Speech-independent production of communicative gestures: Evidence from patients with complete callosal disconnection. Neuropsychologia, 45, 3092-3104.
Lausberg, H., Göttert, R., Münßinger, U., Boegner, F., & Marx, P. (1999). Cal-losal disconnection syndrome in a left-handed patient due to infarction of the total length of the corpus callosum. Neuropsychologia, 37(3), 253-265.
Lausberg, H., Cruz, R.F., Kita, S., Zaidel, E., & Ptito, A . ( 2003). Pantomime to visual presentation of objects: Left hand dyspraxia in patients with complete callosotomy. Brain 126, 343-360.
Lausberg, H., Cruz, R.F., Kita, S., Zaidel, E., & Ptito, A. (2003). Pantomime to visual presentation of objects: left hand dyspraxia in patients with complete cal-losotomy. Brain, 126, 343-360.
Le May, A., David, R., & Thomas, A.P. (1988). The use of spontaneous gesture by aphasic patients. Aphasiology, 2(2), 137-145.
Liepmann, H. (1908). Drei Aufsätze aus dem Apraxiegebiet. Berlin: Karger.
Mahl, F.G. (1968). Gestures and Body Movements in Interviews. Research in Psychotherapy, 3, 295-346.
Masneri, S. Schreer, O., Schneider, D., Tschöpel, S., Bardeli, R., Bordag, S., Auer, E., Sloetjes, H., & Wittenburg, P.: Towards Semi-Automatic Annota-tions for Video and Audio Corpora, 4th Workshop on Representation and Processing of Sign Languages: Corpora and Sign Language Technologies in conjunction with 7th Int. Conf. on Language Resources and Evaluation (LREC), Malta, June 22, 2010.
McClave, E., Kim, H., Tamer, R., & Mileff, M. (2007). Head movements in the context of speech in Arabic, Bulgarian, Korean, and African-American Vernacu-lar English. Gesture 7(3): 343-390.
McNeill, D. (1992). Hand and Mind: What gestures reveal about thought.
Chicago: The University of Chicago Press.
Müller, C. (1998). Redebegleitende Gesten - Kulturgeschichte, Theorie, Sprach-vergleich. Berlin: Berlin Verlag Arno Spitz GmbH.
Nichelli, P. (1999). Visuospatial and Imagery Disorders. In G. Denes, &
Pizzamiglio, L. (Ed.), Handbook of Clinical and Experimental Neuropsychology (pp. 453-478). Hove, East Sussex: Psychology Press.
Ochipa, C., Rothi, L.J.G., & Heilman, K.M. (1994). Conduction apraxia. Jour-nal of Neurology, Neurosurgery, and Psychiatry, 57, 1241 - 1244.
Poeck, K., & Kerschensteiner, M. (1975). Analysis of the sequential motor events in oral apraxia. In K. J. Zülch, Creutzfeldt, O., Galbraith, G.C. (Ed.), Cerebral Localization (pp. 98-114). Berlin, Heidelberg, New York: Springer-Verlag.
Poeck, K. (1986). The clinical examination for motor apraxia.
Neuropsychologia, 24(1), 129-134.
Poizner, H., Mack, L., Verfaellie, M., Rothi, L.J.G., & Heilman, K.M. (1990).
Three-dimensional Computergraphic Analysis of Apraxia. Brain, 113, 85-101.
Rapcsak, S.Z., Ochipa, C., Beeson, P.M., & Rubens, A.B. (1993). Praxis and the Right Hemisphere. Brain and Cognition, 23, 181-202.
Roy, E.A., Heath, M., Westwood, D., Schweizer, T.A., Dixon, M.J., Black, S.
E., Kalbfleisch, L., Barbour, K., & Square, P.A. (2000). Task Demands and Limb Apraxia in Stroke. Brain and Cognition, 44, 253-79.
Sainsbury, P. (1954). A method of measuring spontaneous movements by time-sampling motion picture. The Journal of Mental Science 100a: 742-748.
Scheflen, A.E. (1973). Communicational Structure: Analysis of a psychotherapy transaction. Bloomington: Indiana University.
Schirmer, A., Alter, K., Kotz, S.A., & Friederici, A.D. (2001). Lateralization of prosody during language production: A lesion study. Brain and Language, 76, 1-17.
Souza-Posa, J.F., Rohrberg, R., & Mercure, A. (1979). Effects of type of infor-mation (abstract-concrete) and field dependence on asymmetry of hand move-ments during speech. Perceptual and Motor Skills 48, 1323-1330.
Stephens, D. (1983). Hemispheric language dominance and gesture hand prefer-ence. Ph.D. dissertation, Department of Behavioral Sciences, University of Chi-cago.
Wilson, V.E., & Peper, E. (2004). The Effects of Upright and Slumped Postures on the Recall of Positive and Negative Thoughts. Applied Psychophysiology and Biofeedback, 29, 189-195.