Design of virtual 3D instruments for musical interaction

TitleDesign of virtual 3D instruments for musical interaction
Publication TypeConference Paper
Year of Publication1999
AuthorsMulder, A. G. E., S. S. Fels, and K. Mase
EditorMacKenzie, I. S., and J. Stewart
ISBN Number1-55860-632-7

An environment for designing virtual instruments with 3D geometry has been prototyped and applied to realtime sound control and design. It was implemented by ex: tending a realtime, visual programming language called Max/FTS, running on an SGI Onyx, with software objects to interface CyberGloves and Polhemus sensors and to compute human movement and virtual object features. Virtual input devices with behaviours of a rubber balloon and sheet were designed for the control of sound spatialization and timbre parameters. Informal evaluation showed that a sonification inspired by the physical world appears natural and effective. More research is required for a natural sonification of virtual input de vice features such as shape, taking into account possible co-articulation of these features. While both hands can be used for manipulation, left-hand-only interaction with a virtual instrument may be a useful replacement for and extension of the standard music synthesizer keyboard modulation wheel. More research is needed to identify and apply manipulation pragmatics and movement features, and to investigate how they are co-articulated, in the mapping of virtual object parameters.

a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2021 The University of British Columbia