In this workshop we focus on Integrating Technology that enables the students to explore, prototype, create, and demonstrate innovative concepts and experiences using technology. Programing would be the first step towards integrating technology, among other steps, to approach the interactive and intelligent systems, products and related services.
We are aiming to build performative musical instruments and installations that allow for GMIS principles to be implemented in a group setting. Overall, a networked multi-instrument setting will be implemented by using OOCSI as a communication layer, and Processing clients for sensors/interactive front-ends and MIDI translation.
The music or sound will be generated by a MIDI-capable sequencer (e.g., Logic Pro X or Ableton Live) with multi-track audio instruments, effects and audio tracks – which is connected to the OOCSI-MIDI bridge. Processing serves as the basis for implementing interactive clients that might connect to external sensors such as Arduino-connected simple sensing modalities or complex sensors such as Kinect, Leap Motion or else.
Equipment
- All participants need a current laptop (Windows or macOS) and headphones are advised
- Participants will need to work in groups of 3-4 with each a LeapMotion device (we will bring 5, beyond that needs to be bought (for example, from taobao), generation 2 or 3)
- Arduino starter kits need to be bought. See an example from taobao. It is adviced that every student should have an Arduino starter kit, but sharing a kit inside a group would also be fine.
General
- Speaker system will be required, 300-500W + Subwoofer; cables mono jack 6,35mm to speaker (we will bring a mixer with jack output)
- We will bring our own Wifi router that provides a closed system for the connected musical instruments
- Stage or lecture hall with 30 square meters performance space; seating for 20-30 audience
- Presentation screen with beamer needs to be available in the performance space and all other spaces that the workshop uses
- Fast Wifi Internet connection for all participants including teachers (VPN-capable)
Preparation
- Participants need to know how to record sound with their mobile phone and how to convert the recording to stereo mp3
- Processing needs to be installed in version 3 (https://processing.org/download/), Arduino IDE in version 1.8.5 (https://www.arduino.cc/en/Main/Software)
- LeapMotion SDK needs to be installed in version 2 or 3 (https://developer.leapmotion.com/sdk/v2)
- Getting Started with Processing
- The workshop will be held in English
- Lectures
Day-to-day planning draft (hours 9:00-18:00):
| Date | Time | Activity | Teacher |
| 31/10/2017 | morning | Processing: introduction | Jun Hu (JH) |
| afternoon | Processing: variables and graphics | JH | |
| 1/11/2017 | morning | Processing: Control Flow and Functions | JH |
| afternoon | Processing: Arrays and Data Structures | JH | |
| 2/11/2017 | morning | Arduino: introduction | JH |
| afternoon | Processing and Arduino: Serial communication and networking | JH | |
| 03/11/2017 | morning | Processing: GUI and Interactivity | JH |
| afternoon | Processing: Object-oriented Programming | JH | |
| 04/11/2017 | Day off | ||
| 05/11/2017 | morning | Workshop introduction | Bart Hengeveld (BH) |
| afternoon | First assignment (LeapMotion + sound control) | Mathias Funk (MF) | |
| 06/11/2017 | morning | Recap and short performance | BJ + MF |
| afternoon | Second assignment (Simplify and design sounds) | BJ + MF | |
| 07/11/2017 | morning | Introduction to connectivity | MF |
| afternoon | Third assignment (Connected control) | BJ + MF | |
| 08/11/2017 | morning | Brief last iteration | BJ + MF |
| afternoon | Working time | ||
| 09/11/2017 | morning | Recap and short performance | BJ + MF |
| afternoon | Working time + Feedback | BJ + MF | |
| 10/11/2017 | morning | Working time | |
| afternoon | Working time | ||
| 11/11/2017 | morning | Working time | |
| afternoon | Performance + Goodbye | BJ + MF + JH |