A Collection of Consciousness / End of Semester Project

Project Brief: A Collection of Consciousness utilises the method of question and answer to seek out one’s subconscious – psychological and emotional state alike. It then shows the participant a visual and auditory representation of his subconscious.

The set up: A total of 2 screens – one huge projector screen, and another smaller computer screen to look at for the questions. There is also a 3-step ‘dance pad’ for participants to select their answers.

2016-04-21 17.58.29

 

An example of a computer graphic shown on screen:

2016-04-21 17.58.42

 

The ‘dance pad’ was situated right in the centre – enjoying a vantage point of the screen. However, participants had to continually turn their head sideways to look for the questions.

2016-04-21 17.57.20

 

Initial idea:

2016-04-24 03.18.50

Initially, I planned on having the laptop right in front of the screen, but decided against it as it would block the visuals. Also, I planned on using motion sensing to trigger the selection of choices, but decided against it – past experience with it has taught me that different lighting would affect the sensing, and motion sensing as a whole might not be very accurate. Hence, I decided to change to using a touch sensor as my item of choice to trigger off the feedback.

 

Questions

I also planned to have a total of 20 questions at the start. Later, I scaled it down to 7 questions as the patch was becoming too large. I based the style of my questions on the ISFG Personality test. I also researched on the different determinants of one’s consciousness, or to be more accurate, psychological state and came up with the following:

2016-04-24 03.18.30

Thus, I decided to base my questions on these 3 factors:
1. Mental Wellness
2. Emotional Wellness
3. Intellectual Wellness

I do understand that the limited questions might not raise an accurate determination of one’s psychological state, but at present it manages to cover all 3 factors as a whole.

Here are my initially planned 10 ideas:

  1. How are you feeling today? Optimistic (faster), no opinion (slower), disengaged (more jazzy)
  2. You do not mind being the centre of attention. No, maybe, yes (change of beat)
  3. You get tensed up and worried that you cannot fulfil expectations (1-3) (change of colour and size, and zamp)
  4. You have cannot finish your work on time, what do you do? You: Continue working on it hard past the deadline, give up, blame and berate self (ADD ON NEW SOUNDTRACK, faster, slower, becomes white noise etc)
  5. Choose one word. I, me, them (goes down to nil, pale, sound slowly goes down to a steady thump)
  6. You often feel as though you need to justify yourself. Disagree, no opinion, agree
  7. You are _____ that you will be able to achieve your dreams.
    Optimistic, objective, critical
  8. Your travel plans are usually well thought-out. Disagree, neutral, agree
  9. Do you know what you want over the next 5 years? Yes, it’s all planned out, gave it some thought, will see how it goes
  10. You tend to go with the crowd, rather than striking it out on your own. Disagree, mix, agree
  11. Do you like what you see? Yes, No but I want to continue improving, no I wish I could restart
  12. Only you yourself know what you want. Do you see yourself? -> restart

I planned for the user to finish playing the entire round of questions, and the different answers would add on different, unique layers onto the graphic – creating a different, unique shape and colour for each player at the end of the game.

Technically, I used jit.gl.text and banged the questions (in messages) at intervals.

Screen Shot 2016-04-25 at 7.39.11 AM

Here is a small portion of my subpatch for the questions, which were to be shown on the computer screen later during the actual artwork.

 

Graphics

The changes in shape were made by sending messages (eg. Prepend shape – torus) to each individual attrui. In brief, these were altered: shapes, colours, how fast or slow the graphics ‘vibrate’, the range and scope it expands until, and the ‘quickness’ or ‘slowness’ of how fast it moves. Graphics was also rendered and altered in real-time.

To create 3D graphics, jit.gen, jit.gl.gridshape, jit.gl.render, jit.gl.mesh and jit.gl.anim were used. While I initially planned to use jit.gl.mesh, and plot out my own points to be animated (creating a more abstract/different/random shape), I spent a total of 5 days to figure it out, but failed to, hence the final project turned out different from expected. However, I am still pleased with the final outcome.

Screen Shot 2016-04-25 at 7.29.13 AM Screen Shot 2016-04-25 at 7.29.49 AM Screen Shot 2016-04-25 at 7.29.54 AM

Here is my patch for reference.

The graphics was the most challenging portion of my entire project, making or breaking it. Perhaps it was not the most brilliant idea to foray into the untouched lands of openGL, but as I have always been interested in 3D graphics as a whole, it became an interesting experience for me.

 

Sensors/Teabox

Screen Shot 2016-04-25 at 7.43.59 AM

3 dance pads were used, and allowed for participants to send in their chosen responses to the questions to MaxMsp. Only 3 options were allowed, as it seemed more intuitive to the common user.

During the actual tryout on friday 22nd April, I realised that the trigger was far too sensitive, and questions were gone through far too fast. Hence, on the afternoon, I further added the below objects to slow down the sensing:

Screen Shot 2016-04-25 at 7.43.41 AM

The counter value is to be changed – depending on how fast or slow you prefer the trigger to be.

 

Sounds

As the graphic rendering and the sounds were tied between each other, I decided on altering the sounds to firstly: give the sense of being enveloped in the whole experience, and also to further tie up the connection between sound and graphics. As aforementioned, the vibration of the graphics is with accordance to how loud, in terms of decibels, of the sound itself.

A total of 3 sounds were used. The longer the participants played, the more ‘rich’ the sound becomes: it becomes more shrill (higher pitch), and the speed of the soundtrack decreases, just to name a few. The longer you play, the more unorganic and synthetic the sounds become. It ties in with the visuals, which starts of as a red, beating object (that reminds one of the heart), but it starts to gradually take on inorganic, abstract forms. This was symbolic of the birth of a lifeform – firstly, you start off as a beating heart, but life’s experience will gradually shape you into becoming a unique being.

Here are the 3 sounds used:

 

 

See the final artwork in action:

Lights, action! / Gyroscope, lights and sound

This prototype is a further development of the previous ‘swish the sound’, with the addition of chauvet lights.

When the gyroscope is tilted at an angle, there are two responses:

1. Sound is played at the angle the gyroscope is tilted at, and

2. Red light intensifies at the corner the gyroscope is tilted at, washing out the green

Sound is created by using ambisonic, while the control of the light was made by scaling the x and y coordinates of the gyroscope.

Screen Shot 2016-03-28 at 9.23.14 PM

Screen Shot 2016-03-28 at 9.23.39 PM

Scaling of the gyroscope was slightly different (ie. improved) from the previous sound/graphics/gyroscope patch. Now, the greater the tilting of the angle, the greater the intensity of the red lights. However, several improvements could be made:

  • alike to ambisonics, which had a smoother transition when the gyroscope tilt changes, transition between the different chauvet lights could be smoothed out.
  • perhaps the intensity of the ‘chosen’ chauvet light could also be dimmed – this I tried, but could not successfully manipulate the lighting such that it stopped blinking (ie. setting the minimum threshold)

“Radio” [the Singing Jacket] / Assignment 1

Finalised Patch(the singing jacket)

Use of controls to ‘play a radio’ from a playlist. Overall, there will be background music (Soincidence soundtrack) playing throughout the entire duration, while toggling various aspects of the sensors (jacket) will trigger an additional sound to be played, as seen from the playlist above.

Sensors/Feedbacks:

  1. Pressure Sensor (large) placed in pocket:
    Switch it on and off, pause, resume

    whatsapp 3

  2. Bending Sensor placed at wrist:
    Bend Wrist to change tracks

    whatsapp 2

  3. Gyroscope placed at nape of neck:
    Function 1 – [Front/back] Bend back and forth to change volume (The more you bend, the louder it is)
    Function 2 – [Right/left] Bend to your right to change pitch (high pitch with more obvious bend)

    whatsapp 1

Combine all actions and create your own unique song.

 

Comments, and reflections:

  • Prof Demers commented that having the actions not ‘fixed’ by physical boundaries will allow for greater freedom, and subsequently, more ‘fun’ in playing with the jacket. However, it is risky as the feedback is harder to control
  • Creating 2 different feedbacks for the gyroscope is not ideal: while activating one function, the other function is also inadvertently activated (unwanted feedback)
  • Difficult to control 2 feedbacks which requires somewhat similar actions to activate (for gyroscope to change pitch and volume)
  • Swinging hands to activate bending scope was unnatural
  • In reflection, perhaps limiting the scope, or narrowing the threshold for activation would help control the feedback, and simplify ways to activate the feedback
  • I could incorporate the zip/hood of the jacket, etc. zipping the zipper, or wearing the hood
  • Perhaps some sensors could be placed on the body of the user, instead of solely on the jacket as at current

See it in action: