Wednesday 29 April 2009

Roy Lichtenstein - Make sounds visible



Rethinking about this past project Roy Lichtensteins work just jumps to my mind.
His prints basically show sounds transformed into type, one of the main characteristics of comic books. After thinking this idea through I thought of something that might look visually pleasing: replacing all those type-noises with braille...making sound tangible..

Saturday 28 March 2009

Tuesday 17 March 2009

Saturday 7 March 2009

CSM - Design for Performance and Set Show

Went to see this show designed by a good friend, Lauren Glasgow.
There was a cooperation between CSM and London Studio Center students.
The choreography was quite interesting, a couple of pretty original moves in each performance, kinda hard to explain though.
The costumes were pretty nice too.

Anyways it kinda fits with the project.
The designers and choreographers were asked to interpret the 'city skyline' into dance and props.
It's quite an abstract subject to dance to.
Using crumbling costumes and city-themed melodies, the show was quite enjoyable (and just short enough so I didn't lose interest).

Friday 6 March 2009

Ode to a Ford

SPS - 3D Visualisation



The blueprints will hopefully be here soon..
Basically the idea is to take the model of the SPS like seen above and make a whole (person-sized) structure from it.
The idea is that there will be microphones in all four corners of the room/location, as well as one on the roof. The structure will have a screen facing each of those directions. In the structure there will be a database of sound recognition and images that go with the specific sound, which will be revealed on the screen facing that particular way.
For the braille (so blind people can enjoy it too!) there can be a small reel under the screen that turns appropriately and spells out the sound (in words obv).
The pieces will thus interact with its environment.  

Braille Alphabet

The alphabet.
Might have to use this if I'll continue the idea for the SPS for blind people too.

Bedshaped

Cool video and beautiful song.
They removed all the embed options :(

A world without sound

How would the world look (or sound...haha) without sound?
In our modern society, do we actually need sound?
I mean, communication-wise, we don't really need sound.. and alright you'll get the usual arguments of 'but i'll DIE without music' and stuff, but obv thats just silly.
People type faster then they can speak (well i do at least) so we could all walk around with those tiny computers basically talking in txts and chat windows, even in real life..
There would be no sound pollution and stress would def go down.
The only sounds that should come through are alarms (like fire/ambulance/police) and the only people that might have a problem with this (although it could technically be mended) are blind and dyslexic people.

on the plus-side, it would allow the language boundaries to be broken (our own personal chat windows could include language translations so).

SPS

Following the couple of ideas i had earlier, i decided to consider mapping but with sound..
basically, the SPS: Sound Positioning System.
A specific (very specific) location will have one 'key' at a specific (again, very specific) time.

So for example, at [12:10 sitting at the far end table at the LCC canteen] would be a 'key'.
Because sound/noise is everywhere/every time it is quite hard to map, although i guess conceptually it'll be visually pleasing and entertaining.
The SPS could even be adapted to, for example, blind people: including braille on the key and having a couple of keys for the blind persons direct environment..


Monday 2 March 2009

UVA

How cool is this?
Light+Sound..

Sunday 1 March 2009

Elite Beat Agents





So yeah, came across this really fun game... Basically you follow certain patterns on your DS screen with the beat. So you can kinda make sound visible through patterns!

Wednesday 25 February 2009

I+III. Sound Trauma & Hear through the eyes of a deaf person

We go through life absorbing a lot of information.
We hear, see, feel, smell, ... We basically experience our surroundings through our senses.
One trail of thought I wanted to follow is how there are some ways to 'make a bridge' between the senses. How one could see sound, or hear view.

Some interesting things I found:

*) VTS: Vision Through Sound, would allow blind people to hear view... Small article about the subject:

The VTS project was established to enable the visually impaired or disabled to live a happier, more fulfilling life filled with experiences about the environment surrounding them.
VTS uses a mini ITX computer small enough to clip on a belt or keep in a handbag or pocket. It consists of a variety sensors, IR, laser, ultrasonic and visual, providing a 360° field of ”view”.

The main difference between the system and other solutions available is;

· Fully customizable

· As mobile as the user

· Relatively cheap compared to similar devices

· Can be mass produced within Canada

· Works in any environment

· 30hr + battery life and can be recharged in just under 2 hours

The device communicates through sound signals, but can be customized to communicate by words or by other means. The front sensor needs to be placed at eye level, by either clipping it on sunglasses or to a baseball cap. The two side sensors need to be placed at waist height for accurate readings. The sensors are wireless to allow 100% mobility.
The sensors weigh only 100 grams and the computer unit weighs with all batteries and equipment just under 350 grams and has similar dimensions to that of a modern cell phone.
The system can distinguish between different materials, like metal, concrete or people, which may be beneficial when getting used to a new living or working environment.

Other features;

· Can sense difference in elevation (i.e. Curbs or sidewalks)

· Will indicate rough walking terrain

· Observes moving objects and calculates the possibility of a collision

· Can follow paintings on road, guiding the user in a straight line

· Will provide distinguished warning if a collision is evident if current track is maintained.

· Creates real-time 3D sound from all the surrounding objects

The system uses two earplug-sized headphones for communication allowing a near surround experience, while still allowing the user to hear all the noises surrounding them. The warning “alphabet” consists of 300 different signals, but was developed in such way that the user can get fully accustomed to in about a week’s time.

VTS always runs in real-time, and takes just one minute to be fully operational once all the sensors are in place. It follows the head movements of the user, in a way as if fully functioning eyes were used, which means when the user turns his/her head in any direction, the signal changes while scanning objects in the particular direction.The system can also be taught particular objects by material and dimensions and guide the user to them once they’re in range. (i.e. remotes, keys, chairs, glasses etc…)

The technology was originally implemented for surveillance purposes to be used on mobile surveillance robots. Currently we are working on making the system more user friendly and more suitable for less technically inclined people, while improving functionality and practicality.

More information on the technology can be found on www.rotoconcept.com or detailed technical information is available by request.

Besides physically being able to see thanks to sound, the human mind itself registers certain sounds as images. That was what I referred to as Sound Trauma: the mind would associate specific scenes or images to a specific sound. This would mean that whenever that person would hear the sound the images will (subconsciously, sometimes) jump up in his mind. Basically that's what vision is: the way our brain interprets the images captured by our eyes (so yeah, I'm implying that even vision is relative and I guess colorblindness is a nice argument to strengthen my point). One example would be this particular tune.
Try listening to it without reading the title of the video. If you've seen the video this tune is associated with you might understand what I mean.

*) Another thing I've come across is the opposite: light bringing sound to deaf people.
Here's the article:

Scientists have accidentally discovered that infrared light can stimulate neurons in the inner ear like sound waves do. While trying to "weld" nerves with heat from a laser, surgeons found that the light could stimulate the ear nerves extremely precisely. A research team led by Claus-Peter Richter at Northwestern University in Chicago decided to explore this idea further.
Laser light stimulation can target the nerves with high precision because the light doesn’t spread. On the other hand, electrical stimulation (the mechanism behind conventional hearing aids) cannot achieve such precise stimulation because tissue conducts electricity, causing electrical signals to spread and interfere with each other.

Electrical hearing aids use about 20 electrodes to target nerves, and are good enough to allow deaf children to develop speech skills similar to those of hearing children. However, deaf people using the hearing aids can’t hear tonal variations as well, making it difficult for them to enjoy music or communicate in a noisy environment.

By increasing the number of points of stimulation, infrared lasers could be a step toward enabling deaf people to listen to music and complex sounds more fully.

The scientists don’t know exactly how light stimulates the neurons, but they think the accompanying heat may play a role. They plan to investigate the long-term effects of heating neurons in the near future.


So light might play an effect...
Another aspect that is quite interesting; do deaf people actually perceive sound in any way?
A couple of questions are raised. Here are a couple of subjects I found interesting in other forums/blogs:

*)How would deaf people perceive thoughts?



When a person thinks they tend to think in their own voice. if you don’t have the ability to hear your own voice how would your mind perceive the thoughts that require a language.
Me and a good friend got into a creative discussion about this and could not come up with a legitimate answer.

Voice what you think.


*) From Deaf Culture:

Terminology


The word "deaf"


The word deaf is used differently in different contexts, and there is some controversy over its meaning and implications.
Scientific usage

In scientific and medical terms, deafness generally refers to a physical condition characterized by lack of sensitivity to soundSound

Sound is a disturbance of mechanical energy that propagates through matter as a wave....
. Notated as deaf with a lowercase d, this refers to the audiological experience of someone who is partially or wholly lacking hearingHearing (sense) Summary

Hearing, or audition, is one of the traditional five senses and refers to the ability to detect sound....
. In legal terms, deafness is defined by degree of hearing loss. These degrees include profound or total deafness (90 dB - 120 dB or more of hearing loss), severe (60 dB - 90 dB), moderate (30 dB - 60 dB), and mild deafness (10 dB - 30 dB of hearing loss). Both severe and moderate deafness can be referred to as partial deafness or as hard of hearing, while mild deafness is usually called hard of hearing.
Cultural usage

Within the Deaf community, the term Deaf is often capitalized when written, and it refers to a linguistic minorityMinority language

A minority language is a language spoken by a minority of the population of a country....
whose primary language is signedSign language Summary

A sign language is a language which uses manual communication instead of sound to convey meaning - simultaneously combining...
, and who practice social and cultural norms which are distinct from those of the surrounding hearing community. This community does not automatically include all those who are clinically or legally deaf, nor does it exclude every hearing person. According to Baker and Padden, it includes any person or persons who "identifies him/herself as a member of the Deaf community, and other members accept that person as a part of the community."

Deaf vs. hard of hearing vs. hearing-impaired

Deaf generally implies a profound loss of hearing; someone with a partial loss of hearing is more likely to be referred to as hard of hearing or the qualified partially legally deaf. People with varying degrees of hearing loss have also been referred to as hearing-impaired.

The term hard of hearing may be used to describe all degrees of hearing loss up to and including total deafness. It is more likely to be used by individuals who have lost their hearing as an adult, than by those who lose it as an infant or are born deaf. In the case of profound deafness this may be political correctnessPolitical correctness Summary

Political correctness is a term used to describe language that is calculated to provide a minimum of offense, particularly ...
, a euphemismEuphemism

A euphemism is an expression intended by the speaker to be less offensive, disturbing, or troubling to the listener than the...
for the simpler and accurate "deaf." Interestingly, this is seen as a euphemism only from the side of the mainstream. The Deaf community does not generally aspire to be hearing and sees the hard of hearing label as an indication of a mindset that views them pathologically.

Total deafness is quite rare. Most deaf people can hear a little. However, since hearing lossHearing impairment

A hearing impairment is a decrease in the ability to perceive sound....
is generally frequency-based rather than amplitude-based, a deaf person's hearing may not be usable, if the normal frequencies of speech lie in the impaired range.

People with a moderate hearing loss, of about 36–50 dB,
generally describe themselves as "partially deaf." Others who were born hearing, but who have partially lost their hearing through illness or injury are "deafened." Those with a slight hearing loss (eg. about 16–35 dB hearing loss), or have lost some of their hearing in old age may prefer an informal term such as "hard of hearing" or "hearing-impaired".

Those with some functional hearing generally do not take part in the Deaf community, and typically work and socialize with hearing people to the best of their ability. People with all degrees of hearing impairment may encounter discrimination when looking for work, while at their jobs, or when socializing with hearing people.

Other meanings of 'deaf'

Deaf is also used as a colloquialismColloquialism Summary

A colloquialism is an expression not used in formal speech or writing....
to refer to a recalcitrant individual or someone unwilling to listen, obey or acknowledge an authority or partner. The third line of Shakespeare's SonnetSonnet

The term sonnet is derived from the Provenal word sonet and the Italian word sonetto, both meaning little song....
29 provides an example:

When in disgrace with fortune and men's eyes

I all alone beweep my outcast state,

And trouble deaf heaven with my bootless cries,


The phrase "tone deaf" refers to someone who lacks relative pitchRelative pitch

The term relative pitch may denote:...
, or the ability to distinguish between musical notes.

---------------------------------------------------------------------------------------------

To consider a lot of what I just posted now, deaf people do hear sound, the frequencies they translate it to are unusable though. It would be interesting to explore that idea further..
Maybe by linking imaging to 'deaf interpretation of sound' one could try and recreate the environment. This would of course probably apply only to one specific kind of deafness.
How about selective deafness? I mean, when walking down a street we subconsciously categorize the sounds surrounding us and shut out the ones we don't 'need'. The expression "I see/hear only you." comes to mind, as it is physically possible to do that.

Make Sound...Visible - The Research

We got a couple of names of things to look at...
The highlights:

*) Alvin Lucier's Clocker

So clocks aren't only for showing time...

*) The Bike Samba

Same goes for bikes. Nice tune even!

*) Christina Kubisch

"Toward the end of the 1970s, I used the system of electromagnetic induction for my sound installations for the first time. As a principle of acoustic transmission, it is based on the sounds resulting from the mutual interaction of magnetic fields. These fields arise on the one hand from electrical wires traversing the room, in which sounds circulate, and on the other from headphones with magnetic coils, which I developed myself. This system, which I have constantly further developed technically and artistically, was the starting point for numerous sound installations realized all over the world since 1980. The basic idea of these sound spaces is to provide the viewer/listener access to his own individual spaces of time and motion. The musical sequences are experiencable in ever-new variations through the listener's motion. The visitor becomes a "mixer" who can put his piece together individually and determine the time frame for himself."

*) Musical Stairs

How fun is that? Sound and movement, different tones depending on timing and distance..

*) Nicolas Schoffer

Make sound visible? This is definetly one way.





Visible Sound

Basically we have this new project going on for my Moving Image pathway so I'd thought I'd look into the subject.
Get ready for it...we are making sound visible!
Amazing, right?

Well yeah, I'll do my best..
Anyways, when I first heard the brief a couple of thoughts went through my head.
I eventually put them down into a couple of bullet points I'll hopefully address over the course of this project:

I) Sound Trauma
II) Heaviness of Silence
III) Sound through the eyes of a deaf person
IV) Body reacts to sounds

Those are the main ideas...