Sonification of a 3-D Spider Web and Reconstitution for Musical Composition Using Granular Synthesis

Loading...
Thumbnail Image
File version

Version of Record (VoR)

Author(s)
Su, I
Qin, Z
Saraceno, T
Bisshop, A
Mühlethaler, R
Ziporyn, E
Buehler, MJ
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2020
Size
File type(s)
Location
License
Abstract

Three-dimensional spider webs feature highly intricate fiber architectures, which can be represented via 3-D scanning and modeling. To allow novel interpretations of the key features of a 3-D Cyrtophora citricola spider web, we translate complex 3-D data from the original web model into music, using data sonification. We map the spider web data to audio parameters such as pitch, amplitude, and envelope. Paired with a visual representation, the resulting audio allows a unique and holistic immersion into the web that can describe features of the 3-D architecture (fiber distance, lengths, connectivity, and overall porosity of the structure) as a function of spatial location in the web. Using granular synthesis, we further develop a method to extract musical building blocks from the sonified web, transforming the original representation of the web data into new musical compositions. We build a new virtual, interactive musical instrument in which the physical 3-D web data are used to generate new variations in sound through exploration of different spatial locations and grain-processing parameters. The transformation of sound from grains to musical arrangements (variations of melody, rhythm, harmony, chords, etc.) is analogous to the natural bottom–up processing of proteins, resembling the design of sequence and higher-level hierarchical protein material organization from elementary chemical building blocks. The tools documented here open possibilities for creating virtual instruments based on spider webs for live performances and art installations, suggesting new possibilities for immersion into spider web data, and for exploring similarities between protein folding, on the one hand, and assembly and musical expression, on the other.

Journal Title

Computer Music Journal

Conference Title
Book Title
Edition
Volume

44

Issue

4

Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2020 Massachusetts Institute of Technology. The attached file is reproduced here in accordance with the copyright policy of the publisher. Please refer to the journal's website for access to the definitive, published version.

Item Access Status
Note
Access the data
Related item(s)
Subject

Music

Persistent link to this record
Citation

Su, I; Qin, Z; Saraceno, T; Bisshop, A; Mühlethaler, R; Ziporyn, E; Buehler, MJ, Sonification of a 3-D Spider Web and Reconstitution for Musical Composition Using Granular Synthesis, Computer Music Journal, 2020, 44 (4), pp. 43-59

Collections