Category: FYP-Light

LIGHT TEXTURES CLASSIFICATION 

Framework for perceptual experience and understanding of light

LIGHT
– Atmosphere
– Luminosity framework – Spatial structure, Appearance, Source

• Further classify the descriptions into ‘tactile’ or ‘textural’ qualities
  > The descriptions for the ‘atmosphere’ and ‘appearance’ of light hold most words that can be translated into tactile qualities
• Can induce sensory feedback – haptic qualities

LIGHT SOURCE

• I would have to determine what kind of light source I would like to work with – natural vs artificial

INTERACTIVE SPACE
– Transform the way light is experienced in a space -> induce/ trigger a sense of touch/ haptic feedback

Using vibration/ proprietary muscle response:

LIGHT IN SPACE – ARCHITECTURE

Explore the difference in visual textures due to the interaction of light and materials

ARTISTS 

http://www.phonomena.net/hf/

http://www.phonomena.net/ilinx/

Doug Wheeler

SPACE AND PLACE – Yi-Fu Tian

“What sensory organs and experiences enable human beings to have their strong feeling for space and for spatial qualities? Kinaesthesia, sight and touch

• Movements such as the simple ability to kick one’s legs and stretch one’s arms are basic to the awareness of space. Space is experienced directly as having room in which to move. Moreover, by shifting from one place to another, a person acquitters a sense of direction. Forward, backward and sideways are experientially differentiated, that is, known subconsciously in the act of motion.
• Space assumes a rough coordinate frame centred on the mobile and purposive self . Human eyes, which have bifocal overlap and stereoscopic capacity, provide people with a vivid space in three dimensions.
• Experience, however, is necessary to perceive the world as made up of stable three-dimensional objects arranged in space rather than as shifting patterns and colours.
• Touching and manipulating things with the hand yields a world of objects – objects that retain their constancy of shape and size. Reaching for things and playing with them disclose their separateness and relative spacing.
• Purposive movement and perception, both visual and haptic, give human beings their familiar world of disparate objects in space. Space is given by the ability to move. Movements are often directed toward, or repulsed by, objects and places. Hence, space can be variously experienced as the relative location of objects or places, as the distances and expanses that separate or link places, and – more abstractly – as the area defined by a network of places.“

CHAPTER 4 – Body, Personal Relations and Spatial Values

Fundamental principles of spatial organization:
1. The posture and structure of the human body
2. The relations (whether close or distant) between human beings

DIRECTION FOR FINAL FORM – Interactive Space
– Other interesting aspects to consider:
1 . The physicality of space vs. the intangibility of light – Interactions

2. Movement of bodies and bodily actions – walking vs. reaching out

3. Tactile sensations/ vibration – real or artificial?

4. The dimension of time – Can spatial awareness be translated by the relative amount of time spend in a space?
> What can be an indication of time?

5. Temperature – Can give a new sensory experience?

6. Time/ Site-specificity of light – sun light

Over the next 2 weeks:

‘Light textures’ Classification framework
Sensory experiments/ study + results > Creating light atmospheres with different qualities
Prototype of finger tactile sensory substitution (TSS) device to sense ambient light (space)

Deliverables for final presentation:

• Light Textures classification framework
• 360 recordings of the sensory experiments/ immersive atmospheres (would be used for my web design site for fyp documentation) + touch haptic feedback
• One good ‘live’ sensory experiment to be experienced in the ‘perceptual box’
• Prototype of the finger TSS device for spatial/ light sensing

Week 10:

SENSORY EXPERIMENTS – Perceptual box

I built the perceptual box 🙂 I can now conduct my visual-tactile experiments.

Some Visual Experiments:

I experimented with two visual qualities of light that can be experienced visually in my perceptual box.

Some tests:

 

A. RHYTHM

Playing with the ‘blinking’ LED to create rhythm with light
> Varying the interval delay – Create different rhythms

B. MOTION
Using a servo motor to create a rotating wheel to vary the light source.

‘Sensory Modality Transition’ Experiments – Visual-Tactile  (Week 12)

Aim: Associate tactile qualities with Visual Qualities of light

CONSONANCE and DISSONANCE

• Combine textures with the perceived/ disconnected tactile quality of light
  eg. wet texture to some form of light
• Using the experimental framework: three perceptual mode conditions
  Visual expectation (V), Touch alone (T) and Touch following a visual expectation (VT)
• To evaluate:
  Perception of disconfirmation – difference between VT and V
  Expectation effect – difference between VT and T
  Perceptual incongruence – different between V and T

 

Light Textures Classification (Week 11-12)

Referencing ‘Sound Textures Classification’ http://alumni.media.mit.edu/~nsa/SoundTextures/

Human Perception of Sound Textures
– Perception experiments which show that people can compare sound textures, although they lack the vocabulary to express formally their perception

• the subjects share some groupings of sounds textures
• 2 major ways used to discriminate and group textures: The characteristics of the sound (periodic, random, smooth) and the assumed source of the sound (voices, water, machine)
  

Texture or not?

Perceived Characteristics and Parameters:
Come up with possible characteristics and qualifiers of sound textures, and properties that determine if a sound can be called a texture.

CAN I DO THE SAME FOR HUMAN PERCEPTION FOR LIGHT TEXTURES?
> Classify light textures
> Perceived Characteristics and Parameters – Quantifiers and Qualifiers

ISEA DATA gloves workshop – Hugo Escalpalo 

Input gloves
– Measures specific finger anatomic and gestural positions as input
– Haptic feedback: Not as output. The design of the glove has in-built mechanism to incorporate proprietary feedback using Slider Sensors and Springs. When pulled forward, the gloves use resistance to simulate the feeling of grabbing an object.
– Intended to include tracking components to track position in VR

https://www.youtube.com/watch?v=MP9aJ5ThwK0

https://www.youtube.com/watch?v=Be3NTYqN0vA

Week 12-13:

• Come up with a lo-fi prototype for gloves that does not require tech, Using springs to trigger a sense of haptic touch based on gestural and action-based movements (articulation)
• Weight based simulation – Using liquid and hand position to simulate a sense
• Output gloves – Vibration (fingers and palms), Pressure (pull-back action using servo-motors), Weight, Proprietary position or feedback

Direction for Week 14:

1. LIGHT TEXTURES CLASSIFICATION – create framework for perceptual experience and understanding
2. GLOVE (low-tech/ haptic prototype) – design to impart a sense of touch of solid objects
3. SENSORY DISSOCIATION/ ASSOCIATION EXPERIMENTS with light textures

SENSORY EXPERIMENTS

Perceptual box

I am still in the midst of designing my “perceptual box” and fine tuning the details of my sensory experiments.

Referencing:

Yanagisawa, H., & Takatsuji, K. (2015). Effects of visual expectation on perceived tactile perception: An evaluation method of surface texture with expectation effect. International Journal of Design, 9(1).

Surface Texture

• People perceive and/or predict a surface’s characteristics corresponding to each physical attribute through sensory information, a process that we call perceived features (eg. Surface roughness perceived through touch).
• Using a combination of perceived characteristics of surface texture, people perceive a tactile quality, such as “nice to touch”.

Sensory modalities

• During such sensory modality transitions, we expect or predict the perpetual experience that we might have through a subsequent sensory modality by first using a prior modality, such as in the case of expecting a particular tactile perception by first looking at a surface texture.
• On the other hand, prior expectation also affect posterior perceptual experiences – a phenomenon known as the expectation effect.
  
• 3 aspects of experiment:
• Participants were asked to evaluate the tactile quality of a target object under three perceptual mode conditions:
  Visual expectation (V), Touch alone (T) and Touch following a visual expectation (VT)
• To evaluate:
  • Perception of disconfirmation – difference between VT and V
  • Expectation effect – difference between VT and T
  • Perceptual incongruence – different between V and T

Measurement:
Evaluate Tactile feeling using four opposite adjective pairs (“nice to touch-unpleasant to touch”, “smooth-rough”, “hard-soft” and “sticky-slippery”) – Between each adjective pair was a scale comprised of five ranges. Participants responded to each adjective scale by marking the rating on a questionnaire sheet, which employed a semantic differential (SD) scale.

SENSORY EXPERIMENTS 

PART 1
Things I want to explore when I finish constructing the perceptual box. I went back to look at my hypothesis for my project, and I would like to center my experiments through connecting the visual properties of light to the visual qualities of material, and see if a tactile quality can be associated.

1. Playing with Rhythm
   Light quality: Rhythm?
   Visual quality: PatternTrying to connect how rhythmic/ flashing lights to a tactile effect
   
   
2. Ryoji Ikeda – Test Pattern (2013)
   https://www.youtube.com/watch?v=XwjlYpJCBgk
3. Playing with Colour
   Light quality: Frequency?
   Visual quality: ColourConnecting a texture (frequency) to colour
   

   

4. Playing with Colour
   Light quality: Intensity/ Diffusion
   Visual quality: Opacity/ TranslucencyTrying to connect force with sharpness of light

 

 

PART 2

MATERIAL PERCEPTION – Can we perceive/ infer material based on visual results of reflected light?

• Playing around with material’s interaction with light, if light can be given visual forms/ textures
• Recreate the textures/ find tactile similarities with physical materials

Build a hologram in my perceptual box:

https://mashable.com/2016/10/24/holovect-3d-projections-star-wars/

 

Interesting Light phenomenon/ visual textures I noticed:

Ryoji Ikeda – Spectra (2014)

 

Reminds me of:

https://olafureliasson.net/archive/artwork/WEK110941/interpretive-flare-display-of-unthought-thoughts

 

‘Touch’ in Art – What would trigger touch?

Last week, it was mentioned that I could look into works that trigger touch, but I missed out on the example that was given.

Vocab? – To find consensus between descriptions of how light is subjectively perceived

ISEA 2020 – Why Sentience?

DATA GLOVES Workshop 17-18 October

The “Data Gloves” were developed with the purpose of interacting with the VR environment “Human After”, a piece by Anni Garza Lau. Under the problem of the high cost of a set of commercial gloves, we realized that we had the ability to manufacture a pair of gloves with a very detailed ability to acquire information about the position of the fingers for a fraction of the price.

https://www.radiancevr.co/artists/anni-garza-lau/

I am not sure how useful the gloves would be in terms of simulating haptic qualities, instead as a glove to obtain data but we will see how it goes.