top of page

Discovering the Meaning of Deformable Materials in Musical Interaction

Study 3 of PhD Research


This digital appendix includes additional detailed documentation related to the research presented in my PhD thesis and the publication cited below. Please feel free to contact Jianing Zheng if you have any questions about this documentation.

Jianing Zheng, Andrew McPherson, and Nick Bryan-Kinns. 2023. “When Materials Meet Sound: Discovering the Meaning of Deformable Materials in Musical Interaction.” Proceedings of the 2023 ACM Conference on Designing Interactive Systems. Association for Computing Machinery, New York, NY, USA, 976–986. [Full  Paper]

Please click here for the DIS2023 paper

Jianing Zheng and Nick Bryan-Kinns. 2023. “Materials in Musical Interaction: Research through a Material Lens under Musical Context.” Extended Abstract In ACM CHI Conference on Human Factors in Computing Systems (CHI23), April 23-28, 2023, Hamburg, Germany. [Workshop Paper]

Please click here for the CHI2023 workshop paper

Jianing Zheng and Nick Bryan-Kinns. 2022. “DeSound: A Toolkit for Building Functional Prototypes of Digital Musical Instruments.” Extended Abstract on International Workshop on Haptic and Audio Interaction Design. [Workshop Paper]

Please click here for the HAID2022 poster

Please click here for the HAID2022 Work in Progress paper

Material-Sound Interaction Activity

1 / Methodology

This study explores how DMI designers understand deformable sensor materials and how they use these as a resource for creative aesthetic design. Eleven DMI designers were invited to use a selection of deformable sensor materials to create prototype DMIs with them in a design activity. The detailed study procedure can be found here

2 / Study Tools and Materials

The tools and materials including: USB cable for power, audio cables for speaker, pressure and bend sensors, stretch sensors, and the Bela embedded computer and breakout board with speaker. Please click here for picture. 

3 / Code System of Thematic Analysis 

The full list of the code system can be found here

4 / Research Artefacts

Participants were invited to use the provided tools and  materials to build DMIs within limited time. The footage of the design outputs can be found here

bottom of page