ACM - Computers in Entertainment

Sign In  •  Sign Up »

Interactive multi-scale visualizations of tonal evolution in MuSA.RT Opus 2

By Elaine Chew, Alexandre R. J. Francois
Theoretical and Practical Computer Applications in Entertainment, [Vol. 3, No. 4]

DOI: 10.1145/1095534.1095545

The purpose of this article is to describe MuSA.RT Opus 2, an interactive system for tonal visualization of music at multiple scales, and to present examples of the types of musical features and attributes that can be abstracted and visualized by the system. MuSA.RT aims to create an environment by which musical performances can be mapped in real-time to a concrete and visual metaphor for tonal space, wherein we can see the establishment and evolution of the tonal context. In this environment, expert musicians will be able to see the tonal structures of what they play, initiated listeners will be able to visually follow the structures that they hear, and novices can learn to hear the structures that they see. MuSA.RT is both an interactive art installation that can convert musical performances to mathematically elegant graphics and a scientific tool for visualizing the inner workings of tonal induction and tracking algorithms. In this article we describe the mapping strategies for transforming a MIDI stream into tonal structures in 3D space, and our solution for overcoming the challenge of real-time concurrent processing of data streams; we will also give examples and present case studies of visual mappings of music by Pachelbel, Bach, and Barber.

Copyright © 2018. All Rights Reserved


You must have an ACM Student or Professional account, or be a CIE subscriber to read the full text and comment on this article.

Get Access

Join the ACM. Become a member to access premium content and site features, and take full advantage of ACM's outstanding computing information resources, networking opportunities, and other benefits.
Join ACM