手书· 五行
Handwriting・WuXing

For Leap Motion and Chinese calligraphy stroke gesture recognition system

Handwriting・WuXing is a multimedia interactive performance for the Leap Motion controller and Chinese calligraphy stroke gesture recognition system. In this composition, the composer not only to use hands’and fingers’ position data in 3D space reports by the Leap Motion, but combine those accessed data with Machine learning system to build a Chinese calligraphy stroke gesture recognition system, then to control and modify physical modelling sound and live-generate image (Max/MSP and DIPS) in real-time. Therefore, the hands’ movements in the air and dynamic gesture as well as live processing audio and video create lively intermedia experience to reveal the Chinese fivefold philosophy conceptual scheme of the five elements, or WuXing, as dynamic states of change, that many traditional Chinese fields used to explain a wide array of phenomena, from cosmic cycles to the interaction between internal organs, and from the succession of political regimes to the composition of arts.

《手书·五行》是为Leap Motion控制器和中文书法笔画手势识别系统的交互式多媒体作品。在这个 作品中不仅使用leap Motion所提供的手 和手指的在三维空间中的位置信息 ,并且将这些信息与 机器学习系统结合,构建了一个中文书法笔画手势识别系统。以此来控制和调整实 时物理建模声音效果和实时生成的影像。手在空中的运动和动态的手势结合实时运算产生的声音和影像创造出生动的跨媒介体验,展示了 中国古典五行哲学理念,旨在描述从宇宙循环到人体内脏器官关系,从朝代更替到艺术创作等事物的运动形式以及转化的动态关系。

The Composer is live electronics performer, will provide:

1. Computer MacBook Pro with Mac Os X 10.13.6 with Max/ Msp (Version 8.0.2 and 6.10) and Wekinator (Version 2.1.0.4).

2. Audio interface: with 8 output (input and output on TRS).

3. Leap Motion controller.
4. USB-C Digital AV Multiport Adapter.

Organiser should provide following equipment:
1. 8 speakers and 1 sub bass speaker.
2. Projector and Screen, or any other display system.
3. Desk to put computer, audio interface ︎and other device on the stage. 4. Mixing console.