The green pointer indicates the area that is closest and draws the raw depth data from the kinect. We created 3 distance ranges using that information.
The camera however, has a AoE and is unable to detect objects that are <= 51cm.
We tried connecting all 8 solenoids to the arduino board through 2 relays.
Each relay is to be powered by 1 adapter. Using 1 adapter for 2 relays will cause the relays to be switch on and off in turns instead of simultaneously.
The current code uses a random delay inside each loop zone. The program reads the code line by line, and stops the entire reading process when there is a delay. Every loop has to be completed before the program is able to read the distance information from the kinect to determine which zone to activate. The lag is induced as there is no way to constantly read the distance data and jump out without completing a full cycle of the zone loop.
PEN is a sound sculpture that responds to users approaching. The clicking of pens changes from a state of chaos to a calm, unified one as the user moves towards it.
Sampling and converting data received from kinect/ultrasonic sensor into digital data is the backbone to how PEN will work. The data collected will directly translate into how the sound sculpture will react to the user. This binary translation into values to be tracked triggers different states of the scores, which would also affect the state of chaos/calmness of the sounds.
Hardware – The pens could be swapped out and replaced by another object,changing how the entire sculpture would sound like.
Software – The scores work like different pieces of sheet music and the pens, the instruments. We could change what “songs” the pens are playing by changing or modifying the scores.
The ability for the sets of scores to be triggered based on pre-determined distances between the user and the sensor in the code gives the sculpture a life of its own. The code gives PEN a set of logic to be followed and actions to execute when certain requirements were met.
PEN is completely reliant on the interaction between the users and the sculpture. The scores the pens are clicking to will not change without the sensor detecting an object approaching.
The scores selected to be used will also be a variable due to the use of a randomiser. This would make the sounds made by the sculpture appear to be more interesting but still maintaining the same concept of chaos/calmness that we want.
The concept behind PEN plays on the idea of the interstice of sound. With the use of technology, we are able to emphasize the gaps between sounds by exaggerating and enlarging these sounds. Through this change of sounds between chaos and calmness in a short time by something we would normally not pay attention to, we hope to highlight the gaps/silence between sounds to the users.
Loaned out the kinect to test the depth sensor.
Kinect outputs a double image as seen on the right. This is because there is a physical offset between the IR camera and the projector.
Thankfully, this isn’t an issue as all we need is the depth data and not precise location information.
Next, we tried to colour code objects based on how far they are from the kinect.
The sample code we found online did not include the function to purely draw the raw depth distance data.
Look for corey for some help and…
We focused on the code and tried testing out the scores by using the relay first.