Author Archives: ʍıu zɐʍ

About ʍıu zɐʍ

01000001 01100011 01100011 01101111 01110010 01100100 01101001

Interactive II Progress (14th Apr)

Position and scale



secondary webcam add on

we improved on the previous visuals by introducing rotation and scaling to the images. We’ve also added a secondary camera so the user would see how they are affecting the camera. We also edited the audio in Premiere so that the loops are shorter but seamless at the same time.  The following clips are the final audio.

Additional links:

21st Mar   28th Mar   31st Mar   4th Apr   11th Apr 14th Apr

Final submission

Interactive II Progress (11th Apr)

RGB values based on position and area

RGB separation results

Amt of red changes pitch shift

Amt of green will change saw and cycle notes

amt of blue changes types of drum loops being played

After getting some feedback about our work, we’ve decided to change a few things. First of all, we’ve decided to use the amount of color on the screen, rather than the user’s face to change the ambient music. The reason for this was due to the fact that Jit.faces works intermittently, and required the user to maintain full frontal eye contact. Instead, we decided to use cv.jit.blob.centroids.

We’ve also decided to change the individual length of the music tracks and make them distinct so they are aware that they’re affecting the installation.

The amount of green would change the saw (low pitch ambient sound) and the higher pitched cycle notes, the amount of red would change the pitch and its lateral position will play a different soundtrack. Finally, the lateral position of the blue region would change the type of drum loops that will be played.


This was the result of the following patch.

Additional links:

21st Mar   28th Mar   31st Mar   4th Apr   11th Apr 14th Apr

Final submission

Interactive II Progress (4th Apr)

Overall patch at work

position patch


face proximity

We’ve decided to add cv.jit.faces into the patch to detect the user’s face position and scale in relation to the screen to affect the type of music that will be played. We’ve improved the patch up so that the overall contrast and saturation of the displayed image will be increased depending on how close the person Is to the screen, rather than a randomiser.

Also, the lateral position of the user’s face will change the type of music will be played. I took some slightly altered SYNTHI 100 music and edited the clip so that it plays on the loop seamlessly.



qr code playlist

We also tried displaying a set of highly contrasting qr codes as they appeared in grids, and mash well with the grid rendering. The high contrast colors also meant that the shapes were highly responsive to distortions.

Additional links:

21st Mar   28th Mar   31st Mar   4th Apr   11th Apr 14th Apr

Final submission


Interactive II Progress (31st Mar)

We found this youtube tutorial on how to make images into a mesh and affect it with audio input. This takes the brightest points and extrude outward to the viewer. see here


We altered this by taking image from the webcam instead of using images as in the youtube tutorial. For the webcam image, we got it to randomise brightness, contrast and saturation every 5 seconds.

We also had to deal with positioning and orientation of the webcam input because we wanted it to mirror the viewer. So had to make the mesh orientate in the same way as the matrix we get from webcam. Matrix can be re-orientated with DimMap object, but for the mesh we had to play around with the values of its position in the Jit.World objects.

We also got it to display lines and grids based on the peak amplitude and pitch of the sounds being generated.

Randomizer for saturation, brightness and contrast

mesh affected by music

Additional links:

21st Mar   28th Mar   31st Mar   4th Apr   11th Apr 14th Apr

Final submission

Reflections on the garden of forking paths

though i’m not a big fan of obscurantist literature, i’d have to say that the methodology of disseminating information through steganography is quite fascinating. In fact, there exist a condition called typomania in which the sufferer is obsessed with seeing his or her name in publication.

There was a similar incident in real life, where members of Al Qaeda hid secret messages in pornography . If not for the fact that one of the members was arrested in Germany, investigators would not have looked into this video, as it was typically known that pornographic material was frowned upon in the muslim community.

As for the writing style itself, there exists a literary technique in which story writers would write a sentence and have others complete the sentence. The third individual who follows up on the second story writer would then be unable to see what the first person has written, while the fourth writer would only see what the third person has written, and so forth.  The end result is a chaotic and meandering experience, and in certain cases would be used as a framework for writers seeking to break away from procrastination.

Poetics by aristotle:reflection

“For as there are persons who, by conscious art or mere habit, imitate and represent various objects through the medium of color and form, or again by the voice; so in the arts above mentioned, taken as a whole, the imitation is produced by rhythm, language, or ‘harmony,’ either singly or combined.”

For some reason, this particular sentence seemed to have had an effect on me. When it comes a narrative, we often think of it as something that is linear. The only participation we engage in is the watching of the movie. The rhythms and flows are extrapolated and rearranged in a way that makes the viewer subconsciously aware of the inner meaning and psychology of the movie.

More recently, however, theater productions have taken a different approach and made the play interactive in a sense. Viewers are able to walk into sets and see events as they unfold as long as they do not interrupt the performers within the space.

Another example would be in the form of exhibitions and conventions, and instead of a few disjointed sets and the limit of viewing things in a particular lens, i think directors could utilize the three dimensional space and let the environments themselves do the talking.

“The plot, then, is the first principle, and, as it were, the soul of a tragedy; Character holds the second place. A similar fact is seen in painting. The most beautiful colors, laid on confusedly, will not give as much pleasure as the chalk outline of a portrait. Thus Tragedy is the imitation of an action, and of the agents mainly with a view to the action.”

After watching recent reboots of the star wars franchise, and having read the expanded universe, i could not agree with this article more. The reason why the force awakens and rogue one, is because the plots were so convoluted and jumbled that they produced weak characters with nonsensical character motivations. We have rey, a mary sue character who has been established as a strong fighter and a pilot so nothing is left to progress with her. We have finn, a garbage disposal personnel who is suddenly able to fight off trained pilots and fight a trained swordsman without prior experience, all of it mixed into a convoluted story about fighting a vague ominous threat that was never established properly. Add that to the fact that the plot progression steals from the original trilogy and you find a movie that is completely broken. Nowadays, it seems that directors care more about nostalgia and diversity quotas, trying too hard to prove that women can do things just as well as men, instead of asking who they are as a person, what their struggles are and how they overcame it.