There are a great many functions which occur in nature, and one thing that composers have often experimented with is the sonification of those functions. What do the stars in the sky sound like? How about the skyline of New York City? Or the fluctuations of the stock market? What would it mean to "listen" to such things? How can you take a natural process, a set of data, any sort of non-sound signal, and convert it perceptually to sound? For example, is it possible that by listening to a fast playback of the digits of 
or e you could perceive a pattern, as yet undiscovered, that gives a unique personality to these numbers?
Engineers and academics who study this idea often call it auditory display, and besides being artistically interesting, it can have important functional applications. For example, imagine that when the air in your car's tires started to get low, your car started to hum, and got higher and higher as the tires got flatter and flatter (sort of "reverse" sonification).
The academic discipline of auditory display tends to divide this field into three categories (thanks to composer/researcher Ed Childs for the following and for some good ideas in this section):
- audification: the direct rendering of digital data in (usually) sub-audio frequencies to the audible range, using resampling. Example: speeding up an hour of seismological data to play in a second.
- sonification: mapping data with some other meaning into sound
- auditory icons/earcons: using sound in computer GUIs and other technological interfaces to orient users to menu depth, error conditions, etc. For example, a cell phone company could design an AUI for their cell phones so that users do not have to look at the little LCD display while driving to select the desired function.
"The succession of notes in the music corresponds to the natural succession of the Kp indices for the year 1961... The musical interpretration consists of setting up a correlation between the level of the Kp reading and the pitch of the note (in a diatonic collection over four octaves), and compressing the 2,920 readings for the year into just over eight minutes of musical time." (from the liner notes to Charles Dodge, Earth's Magnetic Field, Nonesuch LP H-71250).
Figure .x Charles Dodge is an important computer music composer and pioneer whose early work Earth's Magnetic Field is an interesting example of sonification of a natural function. Dodge (and his collaborator, scientist Bruce Boller) used a graph of what are called the Kp indices, which chart the "average magetic activity" for the earth:
Dodge's Earth's Magnetic Field, excerpt,
Soundfile .x
The process of turning non-aural information into sound is called sonification, and the question of exactly how to do it is often referred to as the mapping problem, since the first thing you need to do is figure out how to map, or relate, the original information to sonic parameters such as pitch, amplitude and timbre.
Let’s take a simple example: what if we want to "listen" to the digits of the number ? How could we do it? Perhaps the simplest way would be to assign each of the numbers 0-9 to a specific frequency, and to play that frequency every time its number comes up. We'll let you try this as an excercise, because we've heard about ten-gazillion undergraduate pieces that use this brilliant idea. Our sophisticated pedagogical response?
ZZZZZZZZ. Pretty boring. Well, maybe the number just isn’t very exciting (don’t tell your geometry teacher!) What if we used Euler's constant, the number e? The two examples (if we made them) would be clearly different, and in some sense we are listening to and e. However, in a larger sense, they wouldn't sound all that much different, because they're both lists of numbers that have very little in common with our musical or even perceptual expectations and experience.
It would be difficult, if not impossible, for most people to know what they were listening to without being told. And artistically, this may not even matter! But one of the primary issues that composers working with sonification need to address is: does it matter if the listening "knows" what they are listening to, and if so, how? How we map data can often be more significant than the data itself. Is there something inherently "musical" about these digits, and if so, are we just not ready to hear it? What do you think?
The motivations behind sonification are similar to those of graphical representations of data — the idea is that by mapping information from one domain onto another we will perceive the data in a new way, and hopefully gain some insight into "what it means." Instead of visualizing something, we auralize it. It’s interesting that in computer music, we often go the other way as well — for instance, a sonogram is a graphical representation of a set of aural data that gives us insights into the sound that we might otherwise not have had. Sonification of the raw data on a hard drive. I am a Nerd, by computer music composer Phil Stone. In this wonderful, silly, gentle parody of computer musicians, Stone used an early single board computer called a SYM (which had 1k of memory) to make the sounds. The "solo" in the middle is the computer simply reading thru it's program memory and translating that as a set of frequencies to it's tiny little speaker. Sonification? The chart above is a typical graphical representation of a discretization of space, used by scientists to solve the complex sets of equations that describe the movement of fluid in some prescribed location (in this case, a horizontal duct into which flow enters across the dashed line at the left, and leaves across the dashed line at the right). The horizontal and vertical arrows and the dots are respectively, the storage locations of the x and y component velocities, and the pressures. By mapping each discrete velocity and pressure to sound as the solver runs, Childs has been trying to present an aural description of the fluid flow solver. There are two sound files below. The first sound file is a direct sonification. The second sound file is a piece built up from ten sonifications with different parameters.
Sonification is not only a musically interesting technique — it’s an idea being studied and used in many areas, particularly as an alternative to visually presented data. For example, airline pilots, who already have enough things to look at (like their Sony PlayStations), might use sonification to "listen" to the status of certain key gauges in the cockpit. Or a scientist studying population growth might listen to population data from a number of countries, to try and hear any similarities or trends that aren’t obvious from the raw or graphed data. Can you think of other areas where sonification might be useful?
Soundfile .x
Composer/researcher Ed Childs has been doing some interesting work in the sonification of complex mathematical problems involving fluid flow, an area which has long been of interest visually.
CFDSound2 from Ed Childs
CFDSound5 from Ed Childs