Novel human computer interaction  development

Human computer interfaces and performance
Human computer interfaces and teaching

Contributors

  • Dr Bruce Wiggins
  • Michael Brown
  • Kristian Lane
  • Alex Gibbins

Following the recent success of the Multi-media Applications project 'Wii are the Music makers' which resulted in local news and radio coverage along with a stand prepared for the 'NanoWhat' event, this projects aim was to both develop novel human computer interfaces and embed this work both into performance (the use of) and technical teaching content (the development of) using cheap, readily available materials which will allow more intuitive control of audio and lighting/show control software (such as Wii controllers and web cams, for example, costing around £20 each to create multi-touch and motion sensing controllers which would normally cost over £2000 each).

The work combined the use of hardware such as webcams, wii controllers and mobile phones along with available software (such as GlovePIE and EyesWeb) and custom written Java applications in order to create flexible, wireless, powerful and intuitive human computer interaction devices which will be used to control various audio/video/lighting parameters in different ways. For example, the motion of someone walking across a stage could be used to control the virtual position of a sound source, or wii controllers handed around the audience to remix audio loops in real-time.

Both the technical and artistic outcomes of this work were presented at the Forum for Innovation in Music Production and Composition, Leeds College of Music, UK with a poster being presented at the University of Derby's Annual Learning, Teachning & Assessment Conference (2009).

View the poster