007 – FYP Progress

Before we start…

I want to apologise for long post. I treat OSS as my platform for filtered train of thoughts. I’ll be updating my thoughts on my own Notion page as well, but I prefer writing here so I can write something properly that can be posted.

Progress Thus Far:

  • Finished reading Cybercognition (not useful)
  • Finished reading Sensory Arts and Design (useful)
  • Finished reading Design Noir: The Secret Life of Electronic Objects (very useful)
  • Watched Akira (not very useful)

Also, I’m tracking my own progress on Notion so I guess I’m opening it up to prof and friends here to take a look:

My ever-changing timeline

My ever-evolving reference sheet

Feel free to take a look and give comments!

Not completed:

  1. Moodboard
  2. Tokyo Cyberpunk
  3. Sensory Pathways for the Plastic Mind Book
  4. Speculative Everything
  5. Journal Readings

SO…

Reading helped me in getting a deeper understanding of the topics I’m covering. I’m clearer in what I want and what I don’t. I won’t be reviewing the books on this post, cos to be honest, some of them aren’t helpful at all and were skimmed within an hour.

The only few I found useful were a chapter  in Sensory Arts and Design talking about extra senses, and many interesting concepts, approaches, and works from Design Noir. I really like Design Noir as the approach to “noir” design taken by the book really resonated in me. I think it helped me in deciding how I will approach the different devices in my FYP.

I didn’t have enough time to read, quite expected. Anyway…

Throwback to 2 weeks ago I wrote that by the end of these 2 weeks, I will:

  1. Good grasp of the concepts I’m trying to use and understand how artists apply these concepts to their work. This is done through all the readings.
    • My answer: I did and I’m happy 😀
  2. Made enough observations and have enough ideas to start creating a proper picture and narrative of what my work will be like. This is done through 2 weeks worth of observation and ideation.
    • My answer: I guess I did but I’m not happy with how little I have thought of

So I can say, my goals from last week were completed, even though the tasks are not.

Some thoughts probably induced by coffee

Balance out humanity with tech: why do we prefer drinking coffee than to directly inject caffeine? Isn’t it more sustainable? But drinking coffee adds so much value to our humanity because it is satisfying to drink, it encourages social behaviour, the process is enriching to our souls

What can my products do to enrich people’s souls? Or at least, retain their soul?

Complex processes help us feel productive and fulfilled. Thats why musical instruments or tactile objects make us feel good. It must be tangible.

When we can feel something, we feel connected to it. Manual car vs auto car. When someone else does it for us, its great for us in terms of productivity, but it lacks a certain value. Why we love analogue and not digital.

Then, how can we simulate an analogous response in digital context?

Also, relevant to think about when our minds do code switching. When we are on digital interface, we want whats smoothest. When we are on physical interface, we want to work for it (only it it adds value)

To sum it up: if it adds value to our life, we want to do it the manual way. If it doesn’t, we want someone else to do it for us.

Need for stimulation and simulation in order for sensory replacement to work. can be subconscious, but must include active input from the brain. This can be seen from me dreaming of Overwatch. Also can be seen in how we bring our hand up to see time, or when we adjust our spectacles, or when we wake up to turn off an alarm. It. Must. Be. Conscious.

From this thought, I kinda know that my devices have to let its user actively do something, to work for the information they want to get. That said, Vibrawatch might not be cut out for this cos it’s very passive.

Updates to Concept

New Inspiration

As the weeks go by, and as I continue reading, I realised that my focus shifts from something more technical to something more conceptual. Instead of wanting to do something relating to sensory substitution and all the specific phenomena, I started thinking further about why I want to do that, and what I’m trying to get at. I started out curious about my alarm problem, then thought about how this can affect the way we use objects to integrate with our senses, to how we can imagine this type of technology in the future that can fit our needs.

I realised that sensory substitution or addition is only a supporting part of my concept (although I still want it to be something all my devices have)

For now, I’m interested in this thing called “Notopia”.

Notopia is a term mentioned on the first page of Dunne & Raby’s book “Design Noir”. I can’t find this anywhere except a few architectural article that defines it as:

“a consequence of the cold logic of market forces combined with a disinterested populace”, “Characterized by a “loss of identity and cultural vibrancy” and “a global pandemic of generic buildings,”

In the book, it is a state of a world where we are given the illusion of technology being the solution to every problem, ‘force-fed’ by ‘corporate futurologists’. Where, as technology develops, human behaviour continues to be controlled and predictable, reinforcing the status quo of things instead of challenging them.

This idea reflects, in my opinion, the reality of consumerism now; products designed to fit our needs, and to put it crudely, to pacify us. We value convenience and ask for products that help our situation in the status quo. Realistically speaking, this works because we can’t suddenly change our behaviours.

But looking in the future, how can this affect us? Can not doing this affect us?

In the book, the solution to Notopia is to subvert the use of daily products through hacking and abusing other qualities of the products that may not be intuitive on first sight. Dunne and Raby created “Placebo Project”, 8 devices that creates a placebo effect for people to feel comforted when being around objects that give out electromagnetic waves (which many people think are harmful to us). This is done through the subversive use of everyday technologies like lamps that switches on when near heat, or compasses embedded into tables that detect magnetic influences.

The project is done with a separate intention (to study “The Secret Life of Electronic Objects” in the interactions), but thinking about it, I think there is some relevance to re-imagining new ways of using existing objects.

I thought this concept is relevant to my project, but now I’m having doubts. So let me think this over, while I go through what I know for certain I want to do.

Properties of my concept

  • My current space is “cabinet of curiosities” styled room of a not-so-far future individual.
  • The inhabitant of the room is a Singaporean youth in the not-so-far future.
  • The aesthetics I’m going for is inspired by the Cyberpunk sci-fi genre as it fits the themes I’m covering (post-humanism). It will be the more “hyper-city” like type of Cyberpunk, rather than the grungy kind; more “utopian”.
  • There will be elements of Singapore hinted in the room that creates a sense of home, but also feels foreign.
  • The devices I’m making will be devices for the sensory-augmented humans of the future. They must work. They must be interactive (visitors can wear them).

Updated one-sentence description

[WIP]

Keywords I will be using

  • Sensory Substitution / Addition
  • Embodied / Embedded Cognition, Enactivism
  • Neuroplasticity
  • Speculative Design
  • Neuro Linguistic Programming
  • Anchors
  • Critical Design

Devices

  • I want my devices to be non-invasive
  • I want my devices to have sensory elements, either in augmentation or substitution that may or may not alter perception
  • My device must be related to a current-day anchor, like an evolved form of it
  • My device have to be interactive and wearable

Goals for next 2 weeks:

Recess

  • Read Cyberpunk Tokyo
  • Read journal article and scientific articles that may help expand (I know I’m doing too much reading and too little doing. I will watch myself)
  • Updating, refining of concept and clear arrangement of information.
  • Moodboard (really start on it!)

Rationale: I just feel like I might miss some information if I don’t finish reading what I set myself to read. But yes I will definitely watch myself now and not let myself go like the last 2 weeks.

To me, establishing a clear and good foundation is important. I want to sort everything out properly as I’m still feeling uncomfortable about some parts of my concept.

Week 8

  • I will have a clear idea of everything by now. So clear that I’m confident.
  • Create first prototype of whatever product I’m making
  • Start ordering things I need
  • Finishing up all research. (this doesn’t mean I’ll stop research, just that all the back-logged research have to be completed)

Goals by end of these 2 weeks

  • Talk to seniors, profs, etc for feedbacks on my concept and ideas
  • (maybe) start thinking of interviewing people that knows the subjects I want to cover, and also people who are using devices that substitute senses
  • I will get my hands dirty finally
  • I will be able to confidently tell people what I’m doing for FYP

Long-term goal (timeline)

When all my research and ideation is done, I will be going into prototyping. During October, I will be doing a lot of prototyping and testing, hoping to get conclusive results by the end of October to go into November AKA Phase 2 for me.

In phase 2, everything will be more urgent and critical. Real products will be made. Plans for grad show will be made.

In phase 3 (February), I should have most of the stuff I need ready and working. Here is where I start doing all the refinement, writing, exhibition, competition, admin stuff, etc done.

See my timeline on Notion for more details

~muse Smol Updates (Not final)

I just want to collect my thoughts in a post. OSS is really a great way for me to not just update on my project but to just think as I write.

CONCEPT UPDATES

FORM

I’ve decided that the projector should be a ceiling lamp that projects the effect onto walls. After testing, I realised that the projector cannot be too close to the wall even though its short-medium throw. The projection is too small to create a decent effect.

I’ve tried to put the projector on the shelf at the back of my room and found it effective, although it still casts my head shadow. I offset the projection to the left of my desk and it works well.

This made me think that hanging it up will work better. And if it’s going to be a ceiling lamp, it should have some additional light for mood as well. I was thinking, in the best case scenario, the lamp can also drown the room into a specific coloured light based on creating the right mood also. For example, blue for calming down, red for active activities, etc.

SENSOR

For the sensor, I wish for it to be a motion detector, but I don’t have it with me so I’ll make do with infrared distance sensor to sense change in distance which suggests fidgeting (not ideal, I know).

OVERALL

For this project, I can’t make it as well as I wish it can, as there isn’t enough time and materials. As mentioned previously, I’ll only work on the visuals for “focus” mode, which is just window light effect, relaxing TV visuals, relaxing sounds. In addition to that, I’ll work on a using the sensor to alter LED colour (to indicate change in mood), TV visuals change, sound cue change (if possible).

For presentation, I’ll also create an interface and graphics to show how the controls and the lamp will look like.

PROGRESS WITH THE PROJECT

So far I’ve been playing with TouchDesigner and learnt quite a bit.

For this project, there are a few parts:

  1. Window: the window light effect
    1. random opacity change
    2. random window effect (multiplied noise)
  2. Window colour: The time of day light colour
    1. controlled by time of day (for this project, I’ll let it run)
  3. LED mood lighting: To change the mood of the room, but I’ll only use a strip of LED to indicate for now.
  4. TV: Visuals to help stimulate the brain
  5. Distance sensor: To detect fidgeting (temporary solution)
    1. Once fidgeting is detected, a counter goes up. If fidgeting stop, counter goes down
    2. When counter reaches max, all activities within TouchDesigner will activate
    3. This includes: change of TV size, change of TV visuals*
  6. Projection case / Lamp case*: Won’t be having this as I don’t have the materials and workshop accessibility
  7. Selector*: Within TouchDesigner, I’ll create different assets and will allow for selection of different assets (in real life, adjusted through interface)
  8. Interface: This will be a graphic just to show how it will look like.

* Not feasible / will only be done when theres enough time!

Also, Pin Yi is working on something similar to mine in terms of the window light visuals, and he shared this reference which I think is very similar to mine. Although its quite the same, I wanna point out that my concept involves interactivity with the visuals which brings about immersion.

leslie nooteboom’s ‘komorebi’ lamp projector plays video looped light-patterns

 


So this OSS post ends here abruptly because I’ve moved on and continued (and finished!) the work instead of typing away. Kinda figured it out…? so I’ll just post this as post for my own thought I guess. You can see everything else in my presentation!

Tutorials (may be helpful to people reading this in the future!)

1. TD for projection mapping: This is useful if you want to know how to do projection mapping with TouchDesigner. The tutorial goes through Kantan Mapper in TD which IMO is quite buggy for Macs but useful nonetheless.

https://www.you- tube.com/watch?v=1Qy- Fy6aJM4U&t=179s

2. TD for different animation effects: This tutorial goes through different animation effects that can help you in learning how different nodes work and how they work together.

https://www.you- tube.com/watch?v=WS4iZxoQT5s

3. Intro to TD: Super long video but worth watching! Recommended by Amanda Lee! The video goes through the different basics of TD. It’s kinda like a crashcourse so after a while you may forget how certain parts work so it goes very well with more tutorials.

https://www.youtube.com/watch?v=w- mM1lCWtn6o&t=2915s

Comments about my project after presentation (reflection…?)

I realised there isn’t much to add as I’ve posted the process in the slides which is in the final project post. So I’ll just write my reflections.

I think it’s fruitful that I learnt a new software that I know I will continue using through the years. Kind of an excuse but I think the pandemic affected my productivity as I settle into the work from home environment. Halfway, I lost sight of the project’s meaning and just went with what I had at that moment and build it from there. But overall I’m quite content with the project.

I wish I can test it more because I think the feeling you get from the projection isn’t very strong. Best if I’m able to test if it can actually help in making you feel focused. I’m honestly more interested in the “reading” mode for this project which I’ll use an effect similar to window light inside a vehicle and a window into the outside of a moving train. That sounds like a nice environment for reading for me haha.

Anyways, yeah if we get to really exhibit it that’ll really be nice. If I’m able to create a cubicle for it. Sadly we can’t so I guess this project will never be fully realised unless I have the discipline to continue it after the pandemic. Will I? I don’t know. But that’s that. It’s been nice working on this and learning new things. Really thankful for Prof. Elke and Merlin for all the useful resources and lessons through the class! Especially the intro to VR which I never experience before, and Unreal Engine which may help in the future.

Ok bye!