Posted on

Workshop @ NWPU Nov 2-11, Xi’an

In this workshop we focus on Integrating Technology that enables the students to explore, prototype, create, and demonstrate innovative concepts and experiences using technology. Programing would be the first step towards integrating technology, among other steps, to approach the interactive and intelligent systems, products and related services.

We are aiming to build performative musical instruments and installations that allow for GMIS principles to be implemented in a group setting. Overall, a networked multi-instrument setting will be implemented by using OOCSI as a communication layer, and Processing clients for sensors/interactive front-ends and MIDI translation.

The music or sound will be generated by a MIDI-capable sequencer (e.g., Logic Pro X or Ableton Live) with multi-track audio instruments, effects and audio tracks – which is connected to the OOCSI-MIDI bridge. Processing serves as the basis for implementing interactive clients that might connect to external sensors such as Arduino-connected simple sensing modalities or complex sensors such as Kinect, Leap Motion or else.


  • All participants need a current laptop (Windows or macOS) and headphones are advised
  • Participants will need to work in groups of 3-4 with each a LeapMotion device (we will bring 5, beyond that needs to be bought (for example, from taobao), generation 2 or 3)
  • Arduino starter kits need to be bought. See an example from taobao. It is adviced that every student should have an Arduino starter kit, but sharing a kit inside a group would also be fine.


  • Speaker system will be required, 300-500W + Subwoofer; cables mono jack 6,35mm to speaker (we will bring a mixer with jack output)
  • We will bring our own Wifi router that provides a closed system for the connected musical instruments
  • Stage or lecture hall with 30 square meters performance space; seating for 20-30 audience
  • Presentation screen with beamer needs to be available in the performance space and all other spaces that the workshop uses
  • Fast Wifi Internet connection for all participants including teachers (VPN-capable)


Day-to-day planning draft (hours 9:00-18:00):

Date Time Activity Teacher
31/10/2017 morning Processing: introduction Jun Hu (JH)
  afternoon Processing: variables and graphics JH
1/11/2017 morning Processing: Control Flow and Functions JH
  afternoon Processing: Arrays and Data Structures JH
2/11/2017 morning Arduino: introduction JH
  afternoon Processing and Arduino: Serial communication and networking JH
03/11/2017 morning Processing: GUI and Interactivity JH
  afternoon Processing: Object-oriented Programming JH
04/11/2017   Day off  
05/11/2017 morning Workshop introduction Bart Hengeveld (BH)
  afternoon First assignment (LeapMotion + sound control) Mathias Funk (MF)
06/11/2017 morning Recap and short performance BJ + MF
  afternoon Second assignment (Simplify and design sounds) BJ + MF
07/11/2017 morning Introduction to connectivity MF
  afternoon Third assignment (Connected control) BJ + MF
08/11/2017 morning Brief last iteration BJ + MF
  afternoon Working time  
09/11/2017 morning Recap and short performance BJ + MF
  afternoon Working time + Feedback BJ + MF
10/11/2017 morning Working time  
  afternoon Working time  
11/11/2017 morning Working time  
  afternoon Performance + Goodbye BJ + MF + JH