Discovering the Meaning of Deformable Materials in Musical Interaction
Study 3 of PhD Research
Publication
This digital appendix includes additional detailed documentation related to the research presented in my PhD thesis and the publication cited below. Please feel free to contact Jianing Zheng if you have any questions about this documentation.
Jianing Zheng, Andrew McPherson, and Nick Bryan-Kinns. 2023. “When Materials Meet Sound: Discovering the Meaning of Deformable Materials in Musical Interaction.” Proceedings of the 2023 ACM Conference on Designing Interactive Systems. Association for Computing Machinery, New York, NY, USA, 976–986. [Full Paper]
​
Please click here for the DIS2023 paper
​
Jianing Zheng and Nick Bryan-Kinns. 2023. “Materials in Musical Interaction: Research through a Material Lens under Musical Context.” Extended Abstract In ACM CHI Conference on Human Factors in Computing Systems (CHI23), April 23-28, 2023, Hamburg, Germany. [Workshop Paper]
​
Please click here for the CHI2023 workshop paper
​
Jianing Zheng and Nick Bryan-Kinns. 2022. “DeSound: A Toolkit for Building Functional Prototypes of Digital Musical Instruments.” Extended Abstract on International Workshop on Haptic and Audio Interaction Design. [Workshop Paper]
​
Please click here for the HAID2022 poster
Please click here for the HAID2022 Work in Progress paper
Material-Sound Interaction Activity
1 / Methodology
This study explores how DMI designers understand deformable sensor materials and how they use these as a resource for creative aesthetic design. Eleven DMI designers were invited to use a selection of deformable sensor materials to create prototype DMIs with them in a design activity. The detailed study procedure can be found here.
2 / Study Tools and Materials
The tools and materials including: USB cable for power, audio cables for speaker, pressure and bend sensors, stretch sensors, and the Bela embedded computer and breakout board with speaker. Please click here for picture.
3 / Code System of Thematic Analysis
The full list of the code system can be found here.
4 / Research Artefacts
Participants were invited to use the provided tools and materials to build DMIs within limited time. The footage of the design outputs can be found here.