top of page

Matter Podcast

Narrative explanation of concept

 

  The story starts from here. It is 2022, our character, 7 year-old little Jen is having her birthday party with her big family. After she cut the cake and everyone enjoyed it, she began to open her gifts. The cube MP3 with a pin-style detector was from mommy and daddy, Jen wore the earphone and pushed the play bottom. She heard a special music she had never heard before.
  "What is it?" she asked.
  "This is the sound of the air when you are born." answered by her mom.
  Little Jen's elder cousin Annie said: "This is a Matter Podcast; I have one on my last year's birthday. Do you remember the song I sent you last week? It's the moon."
  "I don't understand, why it is the moon, and why is it the sound of the air?" Jen was still confused.
  "Well, this is magic, you can put this pin on anything you want to, then you can hear music of it, my mom told me it will create music when you touch different materials." Annie explained to Jen. "And do you remember my neighbor Miss Johnson? You know she is legally blind, but sometimes I can see her sitting in her garden and using this product to hear the plants. She told me even she can't see what the flowers look like, but at least she can hear the music of them. She also told me the music of stars and nebulas are nice, just like the melody from heaven. I can share some of my collection with you. They are interesting."
  Fascinated by the new way to explore the world for an active kid, Jen soon found out this was the best gift, just like what Annie thought after her birthday.

  So what is this Matter Podcast? How and where does it work? Who will use it? Here are the answers:
  The Matter Podcast is built base on the technology of multiple algorithms which can process massive data from the database offered by professional research institutes such as NASA, NOAA, USGS, GSA, and work out the final analysis result as delightful melody for human audience. (The whole premise is: music is created base on the data analyzed by the research institute, not the material itself. )
The origin model of this music player is an algorithm developed by GaTech students who have done a research on sonification star data into music.
  The data are some information collected by the scientists for science research, for example, the duration of the brightness of stars in the sky, the structural layer of the great canyon, the mineral composition of the Pacific Ocean etc. Those data are meaningless and hard to understand for normal people, however due to auralization transfer, these complicated data constitute a new music world and waiting for people to discover by using their understanding to music.
Some materials are distinctive individually but some are not, for example, it is a difference between coffer and coke, but the air in Skile 345 and Skile 346, it might be the same.
All the given consequence is depended on the materials and the database, so it is possible that two person in different places holding two leaves from the same kind of tree can hear the same music.
  There are two user terminals. One is indoors terminal on the PC platforms. Users can open the player program, login to their accounts and enjoy music of diverse materials sends by the remote center server; they can also find a certain item and listen to it. Some science amateur can listen to the particular music when they are browsing the introduction of Mars on NASA website. The other terminal is for outdoors and it is a portable MP3 with a special pin-style detector, users can listen to what they already have, also they can use the detector to perceive the material; the collector will pick-up information and send to the remote center server via Wi-Fi, the computer will seek corresponding data in the database and work out the music, and send it back to the receiver in the portable music player.
  This will be a good choice to create distinctive auditory memory, and the sonification information increases the information accepted by users, and decreases the load of the visual channel, and can observe the data in a whole new way.
  This product is targeted to ordinary people and blind people. For the former users, this is a new experience to taste the beauty of data, and strengthen pleasure of the sense of hearing; they can even make some comparison between materials they might never have a chance to touch, such as outer space or the earth's core. For the latter users, they can have better understanding of the invisible world, and get to perceive some abstract conceptions which are hard to describe, such as stars and moon, blue and red; combined with the sense of touching, smelling and tasting, this product can help blind people to feel the world much better than before.

Narrative explanation of process

 

  Based on Tech student's research A SONIFICATION OF KEPLER SPACE TELESCOPE STAR DATA, I build up my concept of creating a music player to broadcast music of materials, which name is Matter Podcast.
  Here is the abstract of the research paper, simply explain what those students had done:
  A performing artist group interested in including a sonification of star data from NASA's Kepler space telescope in their next album release approached the Georgia Tech Sonification Lab for assistance in the process. The artists had few constraints for the authors other than wanting the end product to be true to the data, and a musically appealing "heavenly" sound. Several sonifications of the data were created using various techniques, each resulting in a different sounding representation of the Kepler data. The details of this process are discussed in this poster. Ultimately, the researchers were able to produce the desired sounds via sound synthesis, and the artists plan to incorporate them into their next album release.
  The reason why I chose this research, is because I regarded it as a challenge that how to express “music, hearing” such abstract conceptions in a graphic picture; as well as the strong desire to have a chance to listen to the music they’ve done.
  In the paper, the author mentioned the data that they were given were produced by NASA's Kepler space telescope and were gathered from the public site planethunters.org. The data contained brightness values for certain stars across long periods of time.
  There is one point to be clear: the audiences are not listening to the photo or picture, but the data behind the material analysis result.
Listen to the universe
  So my first thought was since they have the method to process one group of star data, they are capable to process all groups of star data. In this case, it will be possible to listen to different pieces of the whole universe.
  Combine with experience of using Pandora music player; it will be a better idea to listen to random stars since most people do not have an abundant knowledge of astronomy. Further, when we are fascinated by those beautiful nebula photos, will it be cute to have just one click and hear the "story" behind that?
  Listen to different material
I got deeper exploration idea in the class that my classmates suggested me why not let the music player able to create music of diverse materials. Not just stars, but Canyon, stones, or even puppies!
I thought those are excellent suggestions, since we are now able to get data of stars, why can't we get data of stones, water and plants? I believe scientists must already build up an ample database and those can be easily applied into music synthesis so long as we have the specific algorithm.
Therefore, through using one or multiple algorithm to analyze the data offered by professional research institutes, (the National Oceanic and Atmospheric Administration, the Geological Society of America, the United States Geological Survey, the National Aeronautics and Space Administration etc.) to create a natural symphony is no longer a dream.
Who use it?
  I discussed my idea with Ray on our way to the grocery and he asked me a question: "Whose goanna to use this stuff?"
  The basic answer showed in my brain is "whoever wants to hear the sounds of materials".
  Then I imagined a picture in my mind that one person is holding a pin or something connected with earphone in his ears, standing in a forest-like scene and touching different leaves, trying to hear distinctive music because those leaves belong to distinct genus.
  "So why does a person need to LISTEN to a leaf rather than directly observe it?" asked by Ray.
  "Unless he can't see!" I blurted out.
  And this answer turned out to be a novel idea. For blind people, they rely on the sense of hearing, touching, smelling and tasting to feel the outside world. Nonetheless, what if there is something they can't taste or smell, and also hard to distinguish by touch? For example, can blind people feel blue sky or a cloudy sky? And what does blue mean to them since they can't see any color?
  It reminded me a story in the book Three Days To See written by Helen Keller. Her family teacher taught her what water is by letting it run through her hands. However, what if Helen Keller asked her teacher what is the difference between water from the distilled water and the Mississippi? And this time, sense of touching is not a good method because they all felt cold and fluid because they are both liquid, let alone the possibility to get the water from the river.
  Those questions mentioned above are abstract and can't explain clearly by simple solutions. Maybe we can never let a blind person know what is blue or what is red, but isn't it still a good idea to provide them with a chance to hear sounds of blue and red?
  To say the least, not only for disable groups, normal people can also benefit from this design, you might never be able to climb to the top of Everest, but you have a chance to listen to the air in Qomolangma and make a comparison between the one in your garden. And please think of this romantic scene that a young lady opens an email attachment from her long-distance boyfriend, with words "This is the air when I am missing you" in the email.
  Where to use?
  In the initial idea, the music player is just a computer based program with a backstage connection to massive science database, audiences sit in front of the computer and listen to everything they want, but along with the idea developed, a portable music player becomes reasonable, it can be used as a collector and receiver, due to the Wi-Fi for data transfer, an outdoors audience can hear music from materials too, with the help of new media, he can even share this music to his friend via social network medium. 
  Hence, there are two places to use this product, indoors and outdoors.
When audiences use it indoors, they can hear everything they want to hear, especially those materials which are untouchable. 
When outdoors, they can use it to listen to the world around them by using a detector to touch the materials, or turn on the random mode if they want to.

bottom of page