Musical communication can be considered as a form of social interaction and it requires a certain degree of inter-individual cortical synchronization. Scientific literature has shown that visual experience is necessary for social interaction and visual impairment negatively influences nonverbal communication both in children and adults. In this study, we present a pilot multimodal dataset to investigate the role that visual experience plays in the context of musical interaction. We selected a mixed interaction scenario (i.e., sighted and blind performers) to investigate non-verbal communication patterns. In particular, we recorded motion tracking data to analyze the interaction between two musicians in three different contexts with the same cellist as soloist accompanied by a (1) blind pianist, (2) sighted pianist, and (3) sighted but blindfolded pianist. Recordings comprised upper-body motion capture and audio data. We also investigated human perception of changes in non-verbal behaviors, by means of an online annotation questionnaire. Preliminary results are presented.

Sensorimotor Synchronization in Blind Musicians: Does Lack of Vision Influencenon-verbal Musical Communication

Volta E.;Cappagli G.;Gori M.;Volpe G.
2021-01-01

Abstract

Musical communication can be considered as a form of social interaction and it requires a certain degree of inter-individual cortical synchronization. Scientific literature has shown that visual experience is necessary for social interaction and visual impairment negatively influences nonverbal communication both in children and adults. In this study, we present a pilot multimodal dataset to investigate the role that visual experience plays in the context of musical interaction. We selected a mixed interaction scenario (i.e., sighted and blind performers) to investigate non-verbal communication patterns. In particular, we recorded motion tracking data to analyze the interaction between two musicians in three different contexts with the same cellist as soloist accompanied by a (1) blind pianist, (2) sighted pianist, and (3) sighted but blindfolded pianist. Recordings comprised upper-body motion capture and audio data. We also investigated human perception of changes in non-verbal behaviors, by means of an online annotation questionnaire. Preliminary results are presented.
File in questo prodotto:
File Dimensione Formato  
2021_conferences_icmi_1.pdf

accesso chiuso

Descrizione: Contributo in atti di convegno
Tipologia: Documento in versione editoriale
Dimensione 841.99 kB
Formato Adobe PDF
841.99 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11567/1086454
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact