FYP 20/21 Week 12 Updates


Framework for perceptual experience and understanding of light

– Atmosphere
– Luminosity framework – Spatial structure, Appearance, Source

  • Further classify the descriptions into ‘tactile’ or ‘textural’ qualities
    > The descriptions for the ‘atmosphere’ and ‘appearance’ of light hold most words that can be translated into tactile qualities
  • Can induce sensory feedback – haptic qualities


  • I would have to determine what kind of light source I would like to work with – natural vs artificial

– Transform the way light is experienced in a space -> induce/ trigger a sense of touch/ haptic feedback

Using vibration/ proprietary muscle response:

Some sketches


Explore the difference in visual textures due to the interaction of light and materials

Church of Light (1989), Tadao Ando
Thermal bath, Vals, Switzerland (1996), Peter Zumthor




Doug Wheeler


“What sensory organs and experiences enable human beings to have their strong feeling for space and for spatial qualities? Kinaesthesia, sight and touch

  • Movements such as the simple ability to kick one’s legs and stretch one’s arms are basic to the awareness of space. Space is experienced directly as having room in which to move. Moreover, by shifting from one place to another, a person acquitters a sense of direction. Forward, backward and sideways are experientially differentiated, that is, known subconsciously in the act of motion.
  • Space assumes a rough coordinate frame centred on the mobile and purposive self . Human eyes, which have bifocal overlap and stereoscopic capacity, provide people with a vivid space in three dimensions.
  • Experience, however, is necessary to perceive the world as made up of stable three-dimensional objects arranged in space rather than as shifting patterns and colours.
  • Touching and manipulating things with the hand yields a world of objects – objects that retain their constancy of shape and size. Reaching for things and playing with them disclose their separateness and relative spacing.
  • Purposive movement and perception, both visual and haptic, give human beings their familiar world of disparate objects in space. Space is given by the ability to move. Movements are often directed toward, or repulsed by, objects and places. Hence, space can be variously experienced as the relative location of objects or places, as the distances and expanses that separate or link places, and – more abstractly – as the area defined by a network of places.

CHAPTER 4 – Body, Personal Relations and Spatial Values

Fundamental principles of spatial organization:
1. The posture and structure of the human body
2. The relations (whether close or distant) between human beings

– Other interesting aspects to consider:
1 . The physicality of space vs. the intangibility of light – Interactions

2. Movement of bodies and bodily actions – walking vs. reaching out

3. Tactile sensations/ vibration – real or artificial?

4. The dimension of time – Can spatial awareness be translated by the relative amount of time spend in a space?
> What can be an indication of time?

5. Temperature – Can give a new sensory experience?

6. Time/ Site-specificity of light – sun light

Over the next 2 weeks:

‘Light textures’ Classification framework
Sensory experiments/ study + results > Creating light atmospheres with different qualities
Prototype of finger tactile sensory substitution (TSS) device to sense ambient light (space)

Deliverables for final presentation:

  • Light Textures classification framework
  • 360 recordings of the sensory experiments/ immersive atmospheres (would be used for my web design site for fyp documentation) + touch haptic feedback
  • One good ‘live’ sensory experiment to be experienced in the ‘perceptual box’
  • Prototype of the finger TSS device for spatial/ light sensing

FYP 20/21 Week 10 Updates and direction for Week 14

Week 10:


I built the perceptual box 🙂 I can now conduct my visual-tactile experiments.

Some Visual Experiments:

I experimented with two visual qualities of light that can be experienced visually in my perceptual box.

Some tests:



Playing with the ‘blinking’ LED to create rhythm with light
> Varying the interval delay – Create different rhythms

Using a servo motor to create a rotating wheel to vary the light source.

‘Sensory Modality Transition’ Experiments – Visual-Tactile  (Week 12)

Aim: Associate tactile qualities with Visual Qualities of light


  • Combine textures with the perceived/ disconnected tactile quality of light
    eg. wet texture to some form of light
  • Using the experimental framework: three perceptual mode conditions
    Visual expectation (V), Touch alone (T) and Touch following a visual expectation (VT)
  • To evaluate:
    Perception of disconfirmation – difference between VT and V
    Expectation effect – difference between VT and T
    Perceptual incongruence – different between V and T


Light Textures Classification (Week 11-12)

Referencing ‘Sound Textures Classification’ http://alumni.media.mit.edu/~nsa/SoundTextures/

Human Perception of Sound Textures
– Perception experiments which show that people can compare sound textures, although they lack the vocabulary to express formally their perception

  • the subjects share some groupings of sounds textures
  • 2 major ways used to discriminate and group textures: The characteristics of the sound (periodic, random, smooth) and the assumed source of the sound (voices, water, machine)

Texture or not?

Perceived Characteristics and Parameters:
Come up with possible characteristics and qualifiers of sound textures, and properties that determine if a sound can be called a texture.

Classify light textures
> Perceived Characteristics and Parameters – Quantifiers and Qualifiers

ISEA DATA gloves workshop – Hugo Escalpalo 

Input gloves
– Measures specific finger anatomic and gestural positions as input
– Haptic feedback: Not as output. The design of the glove has in-built mechanism to incorporate proprietary feedback using Slider Sensors and Springs. When pulled forward, the gloves use resistance to simulate the feeling of grabbing an object.
– Intended to include tracking components to track position in VR



Week 12-13:

  • Come up with a lo-fi prototype for gloves that does not require tech, Using springs to trigger a sense of haptic touch based on gestural and action-based movements (articulation)
  • Weight based simulation – Using liquid and hand position to simulate a sense
  • Output gloves – Vibration (fingers and palms), Pressure (pull-back action using servo-motors), Weight, Proprietary position or feedback

Direction for Week 14:

  1. LIGHT TEXTURES CLASSIFICATION – create framework for perceptual experience and understanding
  2. GLOVE (low-tech/ haptic prototype) – design to impart a sense of touch of solid objects

FYP 20/21 Week 8 Updates


Perceptual box

I am still in the midst of designing my “perceptual box” and fine tuning the details of my sensory experiments.


Yanagisawa, H., & Takatsuji, K. (2015). Effects of visual expectation on perceived tactile perception: An evaluation method of surface texture with expectation effect. International Journal of Design9(1).

Surface Texture

  • People perceive and/or predict a surface’s characteristics corresponding to each physical attribute through sensory information, a process that we call perceived features (eg. Surface roughness perceived through touch).
  • Using a combination of perceived characteristics of surface texture, people perceive a tactile quality, such as “nice to touch”.

Sensory modalities

  • During such sensory modality transitions, we expect or predict the perpetual experience that we might have through a subsequent sensory modality by first using a prior modality, such as in the case of expecting a particular tactile perception by first looking at a surface texture.
  • On the other hand, prior expectation also affect posterior perceptual experiences – a phenomenon known as the expectation effect.
  • 3 aspects of experiment:
  • Participants were asked to evaluate the tactile quality of a target object under three perceptual mode conditions:
    Visual expectation (V), Touch alone (T) and Touch following a visual expectation (VT)
  • To evaluate:
    • Perception of disconfirmation – difference between VT and V
    • Expectation effect – difference between VT and T
    • Perceptual incongruence – different between V and T

Evaluate Tactile feeling using four opposite adjective pairs (“nice to touch-unpleasant to touch”, “smooth-rough”, “hard-soft” and “sticky-slippery”) – Between each adjective pair was a scale comprised of five ranges. Participants responded to each adjective scale by marking the rating on a questionnaire sheet, which employed a semantic differential (SD) scale.


Things I want to explore when I finish constructing the perceptual box. I went back to look at my hypothesis for my project, and I would like to center my experiments through connecting the visual properties of light to the visual qualities of material, and see if a tactile quality can be associated.

  1. Playing with Rhythm
    Light quality: Rhythm?
    Visual quality: PatternTrying to connect how rhythmic/ flashing lights to a tactile effect

  2. Ryoji Ikeda – Test Pattern (2013)
  3. Playing with Colour
    Light quality: Frequency?
    Visual quality: ColourConnecting a texture (frequency) to colour

    Using touch sensors
  4. Playing with Colour
    Light quality: Intensity/ Diffusion
    Visual quality: Opacity/ TranslucencyTrying to connect force with sharpness of light



Slide potentiometer


MATERIAL PERCEPTION – Can we perceive/ infer material based on visual results of reflected light?

  • Playing around with material’s interaction with light, if light can be given visual forms/ textures
  • Recreate the textures/ find tactile similarities with physical materials

Build a hologram in my perceptual box:



Interesting Light phenomenon/ visual textures I noticed:

Ryoji Ikeda – Spectra (2014)


Reminds me of:

Interpretive flare display of unthought thoughts (2020) neugerriemschneider, Berlin Photo: Jens Ziehe



‘Touch’ in Art – What would trigger touch?

Last week, it was mentioned that I could look into works that trigger touch, but I missed out on the example that was given.

Vocab? – To find consensus between descriptions of how light is subjectively perceived

ISEA 2020 – Why Sentience?

DATA GLOVES Workshop 17-18 October

The “Data Gloves” were developed with the purpose of interacting with the VR environment “Human After”, a piece by Anni Garza Lau. Under the problem of the high cost of a set of commercial gloves, we realized that we had the ability to manufacture a pair of gloves with a very detailed ability to acquire information about the position of the fingers for a fraction of the price.


I am not sure how useful the gloves would be in terms of simulating haptic qualities, instead as a glove to obtain data but we will see how it goes.

FYP 20/21 Week 5 Project Updates

For Week 5 and 6, I intend to start on experimentation for my project. My first step for crafting the sensory experiments would be to determine what visual qualities of light I would like and what kinds of light can be used as tools for exploration.

The Lighting Art: The Aesthetics of Stage Lighting Design by Richard H. Palmer
– Chapter 2: Psychophysical Considerations: Light, the Eye, the Brain and Brightness
– Chapter 3: Psychophysical Considerations: Color
– Chapter 4: Psychophysical Considerations: Space and Form Perception

Handbook of Experimental Phenomenology: Visual Perception of Shape, Space and Appearance by Liliana Albertazzi
– Chapter 6: Surface Shape, the Science and the Looks
– Chapter 8: Spatial and Form-Giving qualities of light

Material Perception (Visual and Haptic)

Neural Mechanisms of Material Perception: Quest on Shitsukan / Hidehiko Komatsu  and Naokazu Goda

Visual perception of materials and their properties/ Roland W. Fleming

Visual and Haptic Representations of Material Properties  / Elisabeth Baumgartner, Christiane B. Wiebel and Karl R. Gegenfurtner

Multisensory Texture Perception / Roberta L. Klatzky

Effects of Visual Expectation on Perceived Tactile Perception: An Evaluation Method of Surface Texture with Expectation Effect / Hideyoshi Yanagisawa, Kenji Takatsuji


The main goal of my sensory experiments would be to see if perceived tactile perception can be induced when visually perceiving or interacting with light. My experiments would center around connecting visual qualities of light to those of materials.

I would have to do further studies into visual and textile of materials through the readings, and try to formulate more concrete experiments with light using those that were conducted with materials. I plan to conduct at least two simple experiments in the following week before the presentation on Friday (week 6).

Some concepts/ ideas I am working with:
– Television static and the sensation of uncomfortable tingling or prickling, ‘pins and needles’
– Diffused (soft) vs. Sharp (hard) light, associating a tactile quality to light quality
> If a ray of hard light (laser, projection, etc) comes towards you, would you avoid it with your body?
– Studying motion/ rhythm of light (black and white) and sensory and neural conditions (epilepsy, hypnosis, vertigo, dizziness)
> Replacing objects with light?
– Optical illusions with light? Translating 2D to 3D with projected/ physical light?
> Akiyoshi Kitaoka http://www.ritsumei.ac.jp/~akitaoka/index-e.html
– Squinting at light > diffraction effect

UPDATES (Sensory experiments)
– Will update the type and specifications of the small sensory experiments that I intend to do over the week here

FYP 20/21 Poster Draft + Feedback



HOW – Considerations

FEEDBACK (21/08/2020)

  • Touch the Light
    Haptic feedback for the visually impaired – Navigation through haptic devices
    Interfaces – Muscle stimulator
  • Interaction with Light – link between physical actions and the reaction of light and sound
    > Connecting link with an act/action with a visual/ auditory response
    eg. Laser Forest, Laser Harp
  • Relevance of references/ readings – Connecting the applicable aspects/ inspirations/ philosophies of the works to my idea (eg. Connecting how light is used in architecture to create textures to the specific qualities of light/ how light is seen/ what qualities of light is/ could be haptic?) -> Can be done in comparative analysis
  • Haptic vs. Non-haptic actions and the following output

1. What are the qualities of light that I want to touch?
> Consider controllable properties, the function of the light to be touched, the psychophysical considerations, interaction with other materials, etc

2. Consider the connection/ gap between intended action/ movement and sensory feedback

Some research on Haptics and Human Perception:

Tactile/ Haptic Feedback:
Cutaneous Receptors (perception of touch and pain, simulation of the skin)
mechanoreceptors (sensing pressure and texture
Thermoreceptors: sensing temperature
Nociceptors: sensing pain

Human Perception of touch:
Plasticity – Cortical representation of a particular function can become larger if that function is used often
Spatial Acuity
Temporal Acuity
Vibrotactile Perception – vibration sensation
Texture perception – Spatial cues, Temporal cues
Object Perceptive – Active Touch (experience of the objects you are touching) vs. Passive (experience of stimulation of the skin)

Haptics: technology that involves transmitting digital information through the sense of touch (apply force, vibration and motion to the user)

3. Sense of touch provides tactile information about – the hardness, softness, malleability, or rigidity, etc qualities of objects
> Are these qualities that light possess? Can they be produced and represented physically/ through tactility?
Some qualities that light possess – Intensity (hardness), Diffused (softness), texture, frequency (rhythm), motion(time), colour (temperature), direction (spatial perspective), from, luminousness (unique quality)