Loading...

The NEUROGES® Analysis System for Nonverbal Behavior and Gesture

The Complete Research Coding Manual including an Interactive Video Learning Tool and Coding Template

by Hedda Lausberg (Author)
©2019 Others 366 Pages
Open Access

Summary

The NEUROGES® analysis system is an objective and reliable interdisciplinary research tool for analysis of body movement and gesture. The system has been field-tested on more than 500 individuals from cultures of five continents, including healthy adults and children as well as individuals with mental illness or brain damage, and further, on non-human primates.
Following up on the first book on theoretical background of the NEUROGES® system, which was published in 2013, this book contains the complete coding manual for the application of the system in research including an interactive video learning tool with video examples of all NEUROGES® hand movement and gesture types, training videos, and a template file for the Multimedia Annotator ELAN.

Table Of Contents

  • Cover
  • Title Page
  • Copyright Page
  • Dedication
  • Preface
  • Contents
  • About the Author
  • About the book
  • Citability of the eBook
  • 1 How to use the system in research
  • 1.1 Complete algorithmic analysis
  • 1.2 Algorithmic analysis of one module
  • 1.3 The analysis of one category
  • 1.4 Objectivity of the NEUROGES® values
  • 1.5 Reliability of the NEUROGES® values
  • 1.6 Validity of the NEUROGES® values
  • 1.7 Occurrence, frequency, and duration of the NEUROGES® values
  • 1.8 How to use the coding manual
  • 1.9 How to use the interactive video learning tool, the NEUROGES® template file for the multimedia annotation ELAN, and the annotated NEUROGES® training videos
  • 1.10 How to acquire the NEUROGES® certificate
  • 2 Parts of the body submitted to the analysis
  • 2.1 Upper limbs
  • 2.2 Lower limbs
  • 2.3 Head
  • 2.4 Trunk
  • 3 The Activation category
  • 3.1 Definition of the Activation category
  • 3.2 Data submitted to the Activation assessment
  • 3.3 Criteria for the definition of the Activation values
  • 3.4 Definitions of the Activation values
  • 3.4.1 movement
  • 3.4.2 rest/pose
  • 3.5 Procedure for Step 1 / Module I in NEUROGES® –ELAN
  • 4 The Structure category
  • 4.1 Definition of the Structure category
  • 4.2 Generation of the ‘to-be-coded’ Structure and R/PStructure units
  • 4.2.1 Generation and assessment of to-be-coded Structure and R/PStructureunits
  • 4.2.2 Alternative generation of ‘to-be-coded’ Structure and R/PStructure units
  • 4.3 Criteria for the definition of the Structure values
  • 4.4 Definitions of the Structure and R/PStructure values
  • 4.4.1 irregular
  • 4.4.2 repetitive
  • 4.4.3 phasic
  • 4.4.4 shift
  • 4.4.5 aborted
  • 4.4.6 r/p rest
  • 4.4.7 r/p pose
  • 4.5 Procedure for Step 2 / Module I in NEUROGES® -ELAN
  • 4.5.1 Generation of the ‘to-be-coded’ Structure and R/P Structure units
  • 4.5.2 Coding of the ‘to-be-coded’ Structure and R/P Structure units
  • 4.5.3 Alternative procedure: Manual generation of Step 2 / Module I units and coding
  • 5 The Focus category
  • 5.1 Definition of the Focus category
  • 5.2 Generation of the ‘to-be-coded’ Focus units and selection of the unit phases submitted to Focus assessment
  • 5.2.1 Generation of the ‘to-be-coded’ Focus units
  • 5.2.2 Selection of the unit phases submitted to Focus assessment
  • 5.2.3 Alternative generation of ‘to-be-coded’ Focus units
  • 5.3 Criteria for the definition of the Focus values
  • 5.4 Definitions of the Focus values
  • 5.4.1 within body
  • 5.4.2 on body
  • 5.4.3 on attached object
  • 5.4.4 on separate object
  • 5.4.5 on person
  • 5.4.6 in space
  • 5.5 Generation of StructureFocus units
  • 5.6 Procedure in for Step 3 / Module I in NEUROGES® -ELAN
  • 5.6.1 Generation of the ‘to-be-coded’ Focus units
  • 5.6.2 Selecting and coding the ‘to-be-coded’ Focus units
  • 5.6.3 Alternative procedure: Manual generation of ‘to-be-coded’ Focus units
  • 5.6.4 Generation of the StructureFocus units by concatenating the Structure units and the Focus units
  • 6 The Contact category
  • 6.1 Definition of the Contact category
  • 6.2 Generation of the ‘to-be-coded’ Contact and R/PContact units and selection of the unit phases submitted to Contact assessment
  • 6.2.1 Generation of the ‘to-be-coded’ Contact and R/PContact units
  • 6.2.2 Selection of the unit phases submitted to Contact assessment
  • 6.2.3 Alternative generation of ‘to-be-coded’ Contact and R/PContact units
  • 6.3 Criteria for the definition of the Contact and R/PContact values
  • 6.4 Definitions of the Contact and R/PContact values
  • 6.4.1 act on each other
  • 6.4.2 act as a unit
  • 6.4.3 act apart
  • 6.4.4 Special template value prep-retract
  • 6.4.5 r/p crossed
  • 6.4.6 r/p closed
  • 6.4.7 r/p open
  • 6.5 Generation of StructureFocusContact units and RestPoseR/PContact units
  • 6.6 Procedure for Step 4 / Module II in NEUROGES® -ELAN
  • 6.6.1 Generation of the right hand Unilateral StructureFocus units
  • 6.6.2 Generation of the left hand Unilateral StructureFocus units
  • 6.6.3 Generation of Bilateral ‘to-be-coded’ Contact and R/PContact units
  • 6.6.4 Coding the ‘to-be-coded’ Contact and R/PContact units
  • 6.6.5 Alternative procedure: Manual generation of ‘to-be-coded’ Contact and R/PContact units
  • 6.6.6 Concatenation of StructureFocus values with Contact values and of Rest/Pose values with R/PContact values
  • 6.6.7 Frequency distribution of the StructureFocusContact and the Rest/PoseR/PContact values
  • 7 The Formal Relation category
  • 7.1 Definition of the Formal Relation category
  • 7.2 Generation of the ‘to-be-coded’ Formal Relation units and selection of the unit phases submitted to Formal Relation assessment
  • 7.2.1 Generation of the ‘to-be-coded’ Formal Relation units
  • 7.2.2 Selection of the unit phases submitted to Formal Relation assessment
  • 7.2.3 Alternative generation of ‘to-be-coded’ Formal Relation units
  • 7.3 Criteria for the definition of the Formal Relation values
  • 7.4 Definitions of the Formal Relation values
  • 7.4.1 symmetrical
  • 7.4.2 right hand dominance
  • 7.4.3 left hand dominance
  • 7.4.4 asymmetrical
  • 7.5 Procedure for Step 5 / Module II in NEUROGES® -ELAN
  • 7.5.1 Generation of the ‘to-be-coded’ Formal Relation units
  • 7.5.1.1 Copying the bh_StructureFocusContact units
  • 7.5.1.2 Selecting units with a phasic or repetitive Structure value in both hands
  • 7.5.2 Assessing the ‘to-be-coded’ Formal Relation units
  • 7.5.3 Alternative procedure: Manual generation of ‘to-be-coded’ Formal Relation units
  • 7.5.4 Optional: Concatenation of the Formal Relation values with the StructureFocusContact values
  • 8 The Function category
  • 8.1 Definition of the Function category
  • 8.2 Generation of the ‘to-be-coded’ Function units
  • 8.2.1 Selection of units for the generation of ‘to-be-coded’ Function units
  • 8.2.2 The Formal Relation values as an orientation for the assessment of bilateral ‘to-be-coded’ Function units
  • 8.2.3 The chronology of coding the ‘to-be-coded’ Function units
  • 8.2.4 Alternative generation of ‘to-be-coded’ Function units
  • 8.3 Criteria for the definition of the Function values
  • 8.4 Definitions of the Function values
  • 8.4.1 emotion/attitude
  • 8.4.2 emphasis
  • 8.4.3 egocentric deictic
  • 8.4.4 egocentric direction
  • 8.4.5 pantomime
  • 8.4.6 form presentation
  • 8.4.7 spatial relation presentation
  • 8.4.8 motion quality presentation
  • 8.4.9 object-oriented action
  • 8.4.10 subject-oriented action
  • 8.4.11 emblem/social convention
  • 8.4.11.1 emblem
  • 8.4.11.2 social convention
  • 8.4.12 Special template value different functions
  • 8.5 Procedure for Step 6 / Module III in NEUROGES®–ELAN
  • 8.5.1 Copying units from preceding tiers
  • 8.5.2 Selecting the copied units with a phasic or repetitive Structure
  • 8.5.3 Assessing the ‘to-be-coded’ Function units
  • 8.5.4 Alternative procedure: Manual generation of ‘to-be-coded’ Function units
  • 8.5.5 Optional: Concatenation of the Function values with the values of the preceding categories
  • 9 The Type category
  • 9.1 Definition of the Type category
  • 9.2 Generation of the ‘to-be-coded’ Type units
  • 9.2.1 Selection of units for the generation of ‘to-be-coded’ Type units
  • 9.2.2 Alternative generation of ‘to-be-coded’ Type units
  • 9.3 Criteria for the definition of the Type values
  • 9.4 Definitions of the Type values
  • 9.4.1 Types of the Function value emotion/attitude
  • 9.4.1.1 emotion/attitude–rise
  • 9.4.1.2 emotion/attitude–fall
  • 9.4.1.3 emotion/attitude–clap/beat
  • 9.4.1.4 emotion/attitude–shrug
  • 9.4.1.5 Special template value other e-motion
  • 9.4.2 Types of the Function value emphasis
  • 9.4.2.1 emphasis–baton
  • 9.4.2.2 emphasis–back-toss
  • 9.4.2.3 emphasis–palm-out
  • 9.4.2.4 emphasis–superimposed
  • 9.4.3 Types of the Function value egocentric deictic
  • 9.4.3.1 deictic – external target
  • 9.4.3.2 deictic–You
  • 9.4.3.3 deictic–self
  • 9.4.3.4 deictic–body
  • 9.4.4 Types of the Function value egocentric direction
  • 9.4.4.1 direction–neutral
  • 9.4.4.2 direction–imperative
  • 9.4.4.3 direction–self-related
  • 9.4.5 Types of the Function value pantomime
  • 9.4.5.1 pantomime–intransitive
  • 9.4.5.2 pantomime–transitive-active
  • 9.4.5.3 pantomime–transitive-passive
  • 9.4.6 Types of the Function value form presentation
  • 9.4.6.1 form–shape
  • 9.4.6.2 form–size
  • 9.4.7 Types of the Function value Spatial relation presentation
  • 9.4.7.1 spatial relation–route
  • 9.4.7.2 spatial relation–position
  • 9.4.8 Types of the Function value Motion Quality Presentation
  • 9.4.8.1 motion quality–manner
  • 9.4.8.2 motion quality–dynamics
  • 9.4.9 Specific emblems and social conventions
  • 9.5 Procedure for Step 7 / Module III in NEUROGES®-ELAN
  • 9.5.1 Generation of the ‘to-be-coded’ Type units
  • 9.5.2 Coding the ‘to-be-coded’ Type units
  • 9.5.3 Alternative procedure: Manual generation of ‘to-be-coded’ Type units
  • 10 Supplementary category Technique of Presentation
  • 10.1 Definition of the category Technique of Presentation
  • 10.2 Selection of units for the Technique of Presentation assessment
  • 10.3 Definitions of the Techniques of Presentation values
  • 10.3.1 hand-as-object
  • 10.3.2 enclosure
  • 10.3.3 palpating
  • 10.3.4 tracing
  • 11 Supplementary category Efforts
  • 11.1 Definition of the category Efforts
  • 11.2 Selection of units for the Effort assessment
  • 11.3 Definition of the Effort values
  • 11.3.1 free flow
  • 11.3.2 bound flow
  • 11.3.3 light weight
  • 11.3.4 strong weight
  • 11.3.5 heavy weight
  • 11.3.6 sustained time
  • 11.3.7 sudden time
  • 11.3.8 indirect space
  • 11.3.9 direct space
  • 12 Supplementary category Temporal Structure
  • 12.1 Definition of the category Temporal Structure
  • 12.2 Selection of units for the Temporal Structure assessment
  • 12.3 Definition of the Temporal Structure values
  • 12.3.1 single accents
  • 12.3.2 metrical
  • 12.3.3 rhythmical
  • 13 Supplementary category Target Location
  • 13.1 Definition of the category Target Location
  • 13.2 Selection of the units for the Target Location assessment
  • 13.3 Definition of the Target Location values
  • 13.3.1 right side
  • 13.3.2 left side
  • 13.3.3 body-midline
  • 13.3.4 both sides
  • 14 Supplementary category Execution Hemi-Space
  • 14.1 Definition of the category Execution Hemi-Space
  • 14.2 Selection of units for the Execution Hemi-Space assessment
  • 14.3 Definition of the Execution Hemi-Space values
  • 14.3.1 ipsilateral
  • 14.3.2 contralateral
  • 14.3.3 body-midline
  • 14.3.4 ipsi-contra
  • 15 Supplementary category Referent
  • 15.1 Definition of the category Referent
  • 15.2 Selection of units for the Referent assessment
  • 15.3 Definition of the Referent values
  • 15.3.1 material
  • 15.3.2 non-material
  • 16 Supplementary category Trigger/Motive
  • 16.1 Definition of the category Trigger/Motive
  • 16.2 Selection of units for the Trigger/Motive assessment
  • 16.3 Definition of the Trigger/Motive values
  • 16.3.1 physical regulation
  • 16.3.2 visual appearance
  • 16.3.3 mental regulation
  • 16.3.4 trigger/motive unknown
  • List of Figures
  • List of Tables
  • References

Preface

Nonverbal interaction and gesture researchers can proudly look up on a long and multi-disciplinary history of their research field. Currently, research on nonverbal interaction and gesture is conducted among others in medicine, psychology, neuroscience, linguistics, anthropology, sociology, or computer science. Given the long history, documented since the ancient Greek, and the broad spectrum of research areas, nowadays a substantial body of knowledge on body movement, gesture, and nonverbal interaction research is available.

However, while the exploration of the field by many different scientific disciplines extends the understanding of nonverbal interaction and gesture, the spread across many different scientific disciplines also bears the risk of isolated areas of specialized knowledge caused by a lack of communication between the different disciplines. Unfortunately, this often applies and one important reason for the scant exchange between the scientific disciplines is that many different methods are used. Researchers of different disciplines often do not understand each other’s terminology, methodology including coding systems, and consequently, findings. This condition constitutes a severe obstacle for comparing and relating the results of different studies and for gradually building up a common inter- or even trans-disciplinary corpus of knowledge on body movement, gesture, and nonverbal interaction. Furthermore, many studies in the field still lack a reliable methodology and an operationalization of the behavioral units and gesture types submitted to investigation. As units and types are often not clearly defined, it remains vague what kind of phenomenon had actually been investigated. Different researchers might use the same term, e.g. “symbolic” gesture, but actually refer to different phenomena, or vice versa – a fact that constitutes a severe obstacle in developing a reliable body of knowledge on body movement, gesture, and nonverbal interaction.

The development of the NEUROGES® system, which was made possible by a long-lasting funding of the German Research Association from 1999–2017 (grants LA 1249/1-1, 1-2, 1-3, 2-1), responds to this situation in research. On the one hand, NEUROGES® has become an objective, reliable and user-friendly analysis system for body movements and gestures. A recent review of 18 empirical studies using NEUROGES® in combination with ELAN demonstrated a good objectivity and reliability of the system. On the other hand, NEUROGES® suits as a basic analysis system that can be used across scientific disciplines and thereby facilitates interdisciplinary exchange. Recent studies using NEUROGES® cover a broad range of different scientific disciplines, e.g. linguistics/psycholinguistics, psychology, neuropsychology, medicine, evolutionary anthropology, or criminology. Thus far, altogether more than 500 individuals from different cultures of five continents have been investigated, Germans, British, US Americans, francophone and anglophone Canadians, Suisse, Koreans, Kenyans, and Papua New Guineans, including healthy adults and children as well as individuals with brain damage and with mental illness. Furthermore, NEUROGES® has been used for studies on non-human primates. Finally, NEUROGES® can be combined with other more specialized coding systems such as the Linguistic Annotation System for Gestures (LASG) or the Movement Psychodiagnostic Inventory (MPI).

The present book follows up on the first book “Understanding Body Movement” published 2013 in Peter Lang Academic Research, in which the theoretical background and design of the NEUROGES® system are presented. This second book contains the complete coding manual for the application of the system in research. It further includes an interactive video learning tool that illustrates the assessment algorithm and provides video examples of all NEUROGES® -registered hand movement and gesture types. In addition, four training videos are provided that enable readers to train the application of NEUROGES® and to compare their analyses with a correct solution. Thus, the present book provides all materials needed for an effective self-study of the NEUROGES® system and it enables to a reliable application of the system in research.

I would like to thank the German Research Association for the long-lasting funding of this project and the Peter Lang Company, notably Benjamin Kloss, for publishing the two books on the NEUROGES® system. Furthermore, over the past two decades, discussions with many colleagues from different scientific disciplines have influenced the development to the NEUROGES® system and have made it a truly interdisciplinary tool, notably with Martha Davis, Robyn Flaum Cruz, Miriam Roskild Berger, Norbert Freedman, Georg Goldenberg, Alain Ptito, Eran Zaidel, Joachim Hermsdörfer, Cornelia Müller, Sotaro Kita, Irene Mittelberg, Ellen Fricke, Katja Liebal, Mandana Seyfeddinipur, Janka Bryjovà, Marianne Eberhard-Kaechele, Peter Joraschky, Angela v. Arnim, Harald Skomroch, Ingo Helmich, Robert Rein, Melanie Seiler, Konrad Juszczyk, Oliver Schreer, Ippokrates Konstantinidis, Katharina Reinecke, Niklas Neumann and the many students of the NEUROGES® seminars that have been held since 2007. In particular, the scientific exchange with Han Slöetjes, the main software developer of the ELAN video and audio annotation tool, has been inspiring for the elaboration of the NEUROGES® algorithm and resulted in a highly efficient combination of NEUROGES® and ELAN. Janka Bryjovà has made major contributions to the interactive learning tool, not only by collecting numerous video examples of participants willing to give their consent to publication but also with regards to the aesthetic design of the learning tool. Corinna Klabunde has formatted the manuscript and designed and over the years repeatedly updated the figures of the algorithms in the course of the NEUROGES® development.

Finally, I am thinking of my husband Lothar Stemwedel whose insights were always an inspiration. I miss him deeply.

Cologne, August 2018

Hedda Lausberg

In order to receive your individual password for the login area on the NEUROGES® website www.neuroges-bast.info please send the code of this book to c.klabunde@dshs-koeln.de and h.lausberg@dshs-koeln.de.

Code: x12ynd14jeieng

Contents

I. Introduction to the NEUROGES® analysis system

1How to use the system in research

1.1Complete algorithmic analysis

1.2Algorithmic analysis of one module

1.3The analysis of one category

1.4Objectivity of the NEUROGES® values

1.5Reliability of the NEUROGES® values

1.6Validity of the NEUROGES® values

1.7Occurrence, frequency, and duration of the NEUROGES® values

1.8How to use the coding manual

1.9How to use the interactive video learning tool, the NEUROGES® template file for the multimedia annotation ELAN, and the annotated NEUROGES® training videos

1.10How to acquire the NEUROGES® certificate

2Parts of the body submitted to the analysis

2.1Upper limbs

2.2Lower limbs

2.3Head

2.4Trunk

II. The Kinesic Module (Module I)

3The Activation category

3.1Definition of the Activation category

3.2Data submitted to the Activation assessment

3.3Criteria for the definition of the Activation values

3.4Definitions of the Activation values

3.4.1movement

3.4.2rest/pose

3.5Procedure for Step 1 / Module I in NEUROGES® –ELAN

4The Structure category

4.1Definition of the Structure category

4.2Generation of the ‘to-be-coded’ Structure and R/PStructure units

4.2.1Generation and assessment of to-be-coded Structure and R/PStructure units

4.2.2Alternative generation of ‘to-be-coded’ Structure and R/PStructure units

4.3Criteria for the definition of the Structure values

4.4Definitions of the Structure and R/PStructure values

4.4.1irregular

4.4.2repetitive

4.4.3phasic

4.4.4shift

4.4.5aborted

4.4.6r/p rest

4.4.7r/p pose

4.5Procedure for Step 2 / Module I in NEUROGES®-ELAN

4.5.1Generation of the ‘to-be-coded’ Structure and R/P Structure units

4.5.2Coding of the ‘to-be-coded’ Structure and R/PStructure units

4.5.3Alternative procedure: Manual generation of Step 2 / Module I units and coding

5The Focus category

5.1Definition of the Focus category

5.2Generation of the ‘to-be-coded’ Focus units and selection of the unit phases submitted to Focus assessment

5.2.1Generation of the ‘to-be-coded’ Focus units

5.2.2Selection of the unit phases submitted to Focus assessment

5.2.3Alternative generation of ‘to-be-coded’ Focus units

5.3Criteria for the definition of the Focus values

5.4Definitions of the Focus values

5.4.1within body

5.4.2on body

5.4.3on attached object

5.4.4on separate object

Details

Pages
366
Year
2019
ISBN (PDF)
9783631778524
ISBN (ePUB)
9783631778531
ISBN (MOBI)
9783631778548
ISBN (Softcover)
9783631771723
DOI
10.3726/b15103
Open Access
CC-BY
Language
English
Publication date
2019 (January)
Keywords
movement analysis kinesic behaviour algorithmic analysis interaction cognition mental state
Published
Berlin, Bern, Bruxelles, New York, Oxford, Warszawa, Wien, 2019. 366 pp., […] 18 fig. b/w, 14 tables

Biographical notes

Hedda Lausberg (Author)

Hedda Lausberg is Full Professor of Neurology, Psychosomatic Medicine and Psychiatry at the German Sport University Cologne, as well as Dance Movement Therapist. Her research focuses on movement behavior and gesture in relation to cognitive, emotional, and interactive processes and on movement analysis methodology.

Previous

Title: The NEUROGES® Analysis System for Nonverbal Behavior and Gesture
book preview page numper 1
book preview page numper 2
book preview page numper 3
book preview page numper 4
book preview page numper 5
book preview page numper 6
book preview page numper 7
book preview page numper 8
book preview page numper 9
book preview page numper 10
book preview page numper 11
book preview page numper 12
book preview page numper 13
book preview page numper 14
book preview page numper 15
book preview page numper 16
book preview page numper 17
book preview page numper 18
book preview page numper 19
book preview page numper 20
book preview page numper 21
book preview page numper 22
book preview page numper 23
book preview page numper 24
book preview page numper 25
book preview page numper 26
book preview page numper 27
book preview page numper 28
book preview page numper 29
book preview page numper 30
book preview page numper 31
book preview page numper 32
book preview page numper 33
book preview page numper 34
book preview page numper 35
book preview page numper 36
book preview page numper 37
book preview page numper 38
book preview page numper 39
book preview page numper 40
368 pages