InstructionArt – Choreographic Light

Choreographic Light 

Choreographic Light serves as a choreographic system, consisting of a wearable to reflect light directed by laser and geometric ‘scores’, to generate movement.

Using the behaviours of reflected light, the performers are instructed to draw using the point of light reflected from a point on their bodies. Wearing the reflective objects (as costume), the body becomes a tool of interaction with light (directed by a laser). Given geometric ‘scores’ that corresponds to the music, the performers move to create visualised forms with the wearable tool. The movement of the performer is derivative from the interactions with light and body, as well as their own interpretations of the geometric forms.

Wearable as Choreographic Object

To me, performance has a element of orchestration or script, which comes in many forms from basic instruction, physical and spatial settings to social context. A choreography is a form of instruction to generate movement, loosely defined as the sequence of staged steps and movement. A costume or wearable serves as an extension of the body, which affects or controls the way we move. I would like to explore how a wearable system that manipulates an intangible material, such as light, in space can be used to generate movement.

Initial sketches

Using the “costume” to define movement, I intend to explore the body as the tool for interaction. My idea was to re-interpret the space occupied by our body (physical or virtual in the form of light), and see how our body readapts to the restriction and what kind of movements are controlled or generated.

Bauhaus Costumes – Das Triadische Ballet

Costumes by Oskar Schlemmer (Bauhaus) for the Triadic Ballet, at Metropol Theater in Berlin. Photo: Ernst Schneider, 1926. (Apic/Getty Images)

Schlemmer, the choreographer of Bauhaus ballet, intended for the dancers, adorned with geometric costumes, to explore the reinvented silhouettes of their bodies in the avant-garde performance. The costumes serve as metaphysical forms of expression – removing the fluid fabrics and movements, archetypal of ballet, and replace them with structural forms and their interpreted gestures.

 

Sketch – Small prototypes of reflective costumes

For the InstructionArt performance, I wanted to test small prototypes of reflective object, instead of a costume, on different parts of the body to study how the tool would be used (through the restriction of motion). The wearable objects are designed to be easily worn and in different sizes, with the reflective surfaces that can be interchanged.

Reflective objects that can be worn on different parts of the body
Different shapes can be detached and attached

A laser will be directed to the reflective surface, resulting in a point of light on the wall

Using geometric scores as instruction for movement

As light is an intangible material, the fluid interaction of light and movement is affected by many factors, creating unpredictability in the outcomes. As part of the system, I would like to choreograph the interaction (drawing with the body) using simple lines and geometric forms, such as circles, square and triangles, that can be easily understood while using the tool. I would like to keep the instruction as minimal as possible so that it will not be so distracting. It would serve as a directive for the manipulated light, while the interpretation (the size, orientation and speed) would be up to the dancer.

A geometric score of different lines and shapes is composed for the performance

William Forsythe – Improvisation Technologies 

Improvisation Technologies – Forsythe created video segments about his approach to improvisation for modern dance, to train his company’s dancer. His categorisation of different classes of movement (lines, curves, shapes, etc) can be “analysed as geometrically inscriptive – a formal drawing with the body in space”. I was inspired by his systematic approach of providing techniques/ instruction for improvisation (usually with no choreography), the choreography then becomes a combination or sequences of set/ designed motions.


‘Improvisation’ Free-Moving state: Moving according to Sound

During the process of “drawing with light” with our bodies, I wanted to see how the body would respond when there is no geometric instruction. Through the experience of drawing with the body, I realised that the light drawn are restricted to lines or curves due to the small point of contact of the reflective objects. Under no instruction or ‘free-style’,  I had the performers move according to the way they like or with the music. The performers would then using the light to interact with each other, creating patterns and moving with the other with the music, which created a collaborative visual experience.

Future direction – Semester project?

Moving on, I would like to experiment with bigger forms of reflective objects, so that bigger movements can be generated. I would also fixed different points of light instead of having one for one object/ performer, so that a spatial performance or spectacle could be generated.

Feedback:
– Using movement to generate music – Collaborative performance with different roles for each performer
– Different parts of the body – more dynamic movements

Generative Study – Generating sound using materiality

CONCEPT – Converting texture of three-dimensional forms into sound

My idea is to create a ‘instrumental’ system to generate sound using data from physical materials. To me, instruments are generative systems, while composed music are outcomes. Intrigued by our material perception, I would like to map the patterns of stones (primary medium of interest) and convert the visual data into sound waves/ audio signals in real-time.  I am interested in exploring the perceptual commonalities of our senses of sight, touch and hearing. When we touch a ‘rough’ material and we hear a ‘rough’ sound, how do we cognitively recognise or associate a tactile quality of ‘roughness’ to what we sense? My project is an attempt to connect material textures (through sight and touch) to sound textures.

Perimeters/ Structure of system:

Connecting textural qualities (visual) to auditory qualities, the sound quality will vary according to the type of stone/ texture used. I would define a space when the stones can be placed in the range of the camera lens (kinect). When the stone is stationary, the three dimensional data captured by the camera will be mapped as two-dimensional lines to be converted into sound waves (Need for a software that connects visual data to audio). I will also experiment with other forms of data (numerical based on volume/ texture density) that can be converted into audio data. 

“Oh that sounds like a rough rock!” “That sounds like a smooth stone!”

Interaction design:

Each stone when placed under camera will have a sound loop related to their material qualities. The audience can move the stone to change the sound, using movement feedback as a ‘synthesizer’. Stones of different textures can be switched and combined, to ‘play’ the instrument to generate music in real time. 

Inspirations

  • Ambient Techno
    Connecting atmospheric textures of ambient music with the melodic and rhythmic elements of techno and electro.
  • “Play the Barcoder” by ELECTRONICOS FANTASTICOS, Ei Wada
    https://www.youtube.com/watch?v=bOfpQt4KFCc– Converting patterns into sounds
  • “The sound of the earth” Yuri Suzuki
    http://yurisuzuki.com/artist/the-sound-of-the-earth
    A record player uses textures/ grooves (sound waves directed into the diaphragm) on a record to create vibrations when in contact with a needle. The sound is played through an amplifier. This is an analogue method of generating sound through textures on a “predetermined” record, similar to a conventional artwork.  My projects deals with a digital/ computational system to generate sound as an instrument, as a generative system.
  • “Years” Bartholomäus Traubeck
    http://traubeck.com/works/years

TECHNICAL EXPLORATIONS
– Kinect and processing/ Touchdesigner
– VCV Rack (software modular synthesizer)
– Research into visual-feedback audio software

Reading Reflection 1

A system, composed of parts working together as a whole, is our way of understanding structures and phenomena in the world. One of the reasons why we are so in awe by nature alludes to the power of creation, subjective to the limitations of the human hands. Nature “evolved from the harmony of the myriad of chances and necessity” and is a constellation of systems that generate forms and phenomena. It is in human culture to break down phenomena into systems, for example, formulating scientific principles to explain how the material world works.

We can take inspiration from the organic “processes found in nature” to condition unpredictability into systems that can generate outcomes infinitely. Generative systems are mechanisms used to create structures that “could not be made by human hands”, using computational models that combine encoded  “organic behaviour and spontaneous irregularities” with logic. These systems come in the form of computer language and digital tools, which are malleable in nature. One small change in the code/ algorithm can lead to a variety of outcomes, or different combinations of written code/ conditional factors can be used to achieve the same or similar outcomes.

The process of using computational systems to generate aesthetic processes involves translating individual components into a series of decisions that can serve as building blocks for the desired result. These decisions have to be interpreted as computer code to satisfy each functional element of the system and the programming process involves a lot of reverse-engineering and ‘trial and error’ to work around the tendencies of the computer algorithms used. The art of coding is the clever manipulation of these generative systems – “choosing computational strategies and appropriate parameters in a combination of technical skill and aesthetic intuition.”

It is interesting to think of Generative Art as works categorised by the strategy of adopting a “certain methodology”, as compared to art movements which are paradigms of works defined by the characteristics or ideology. The aesthetic application of rules and systems is key in generative art works, where the artist designs a closed system by setting conditions and perimeters, in which  the unpredictable outcomes exist. Not all generative art has to be code-based, but the art is in the system instead of the results. This allows the work to be timeless, where as long as the conditions of the system are available, the outcomes can be generated infinitely.

The next step for Generative Art:

Watz states that while computer code algorithms are essentially immaterial, they display material properties. It would be interesting to see the material properties translated into sensory ones, where computer code algorithms can be used to generate sensory experiences. Sensory perception is specific to the person, and what one perceive would a subjective experience of the generated sensory activation, which can be seen as a form of unpredictability and generativity.

Zoom Performance – “Blow” and “Sneeze”

Zoom Performances

“Blow”
Performed by Alina and Tanya

“Sneeze”
Performed by Alina and Fizah

In the current times, how often does a sneeze/ cough capture our attention in public? So rarely do we ever feel the “closeness” of another person without fear or are we fully comfortable to do certain acts – such as sneezing or blowing – without them being seen as blasphemous. The performances of “banned actions” are meant to trigger some discomfort, serving as a humorous commentary to the effect of the pandemic on our personal behaviours.

CONCEPT – Play between Action and Response

The virtual performances “Blow” and “Sneeze” explores the link between an action and its resultant effect in disconnected settings. Making use of online communication tool ‘zoom’ and physical objects, the performances aim to create an illusion of ’cause and effect’, using what can and can’t be seen on the screens. By timing and recreating the visual response of an action, the videos attempt to distract the viewers from distance and disjunction between the “connected” individuals.

Concept sketch

Window Display Installation by Tokujin Yoshioka for Maison Hermès, Tokyo

The idea was inspired by an interactive window display by Tokujin Yoshioka where a screen displaying a woman “blowing” into a hanging scarf. The movement of the scarf responds to the simultaneous act of blowing, creating a perception where there is an actual person performing the action. The concept of connecting two disparate platforms is applied to our zoom performances, bridging our “distance” across virtual communication.

FYP 20/21 Poster Draft + Feedback

WHAT

WHY

HOW – Considerations

FEEDBACK (21/08/2020)

  • Touch the Light
    Haptic feedback for the visually impaired – Navigation through haptic devices
    Interfaces – Muscle stimulator
  • Interaction with Light – link between physical actions and the reaction of light and sound
    > Connecting link with an act/action with a visual/ auditory response
    eg. Laser Forest, Laser Harp
  • Relevance of references/ readings – Connecting the applicable aspects/ inspirations/ philosophies of the works to my idea (eg. Connecting how light is used in architecture to create textures to the specific qualities of light/ how light is seen/ what qualities of light is/ could be haptic?) -> Can be done in comparative analysis
  • Haptic vs. Non-haptic actions and the following output

NEXT STEP:
1. What are the qualities of light that I want to touch?
> Consider controllable properties, the function of the light to be touched, the psychophysical considerations, interaction with other materials, etc

2. Consider the connection/ gap between intended action/ movement and sensory feedback

Some research on Haptics and Human Perception:

Tactile/ Haptic Feedback:
Cutaneous Receptors (perception of touch and pain, simulation of the skin)
mechanoreceptors (sensing pressure and texture
Thermoreceptors: sensing temperature
Nociceptors: sensing pain

Human Perception of touch:
Plasticity – Cortical representation of a particular function can become larger if that function is used often
Spatial Acuity
Temporal Acuity
Vibrotactile Perception – vibration sensation
Texture perception – Spatial cues, Temporal cues
Object Perceptive – Active Touch (experience of the objects you are touching) vs. Passive (experience of stimulation of the skin)

Haptics: technology that involves transmitting digital information through the sense of touch (apply force, vibration and motion to the user)

3. Sense of touch provides tactile information about – the hardness, softness, malleability, or rigidity, etc qualities of objects
> Are these qualities that light possess? Can they be produced and represented physically/ through tactility?
Some qualities that light possess – Intensity (hardness), Diffused (softness), texture, frequency (rhythm), motion(time), colour (temperature), direction (spatial perspective), from, luminousness (unique quality) 

 

INTERSPECIFICS – Ontological Machines

INTERSPECIFICS

INTERSPECIFICS is an artist collective from Mexico City (founded 2013), experimenting in the intersection between art and science (Bio-Art/ Bio-Technology). Their creative practice revolves around a collection of experimental research and methodological tools they named “Ontological Machines”, which involve exploring the communication pathways between non-human actors and developed systems, such as machines, algorithms and bio-organisms. Their body of work focuses on the use of sound and AI to deconstruct bioelectrical data and chemical signals of various living organisms as generative instruments for inter-species communication, pushing our understanding of the boundaries of human nature and its counterpart, the non-human.

ONTOLOGICAL MACHINES 

An exhibition presented by INTERSPECIFICS of two installation-based sets of hardware they define as ‘ontological machines’. The methodological classification serves as a framework to explore the complex expressions of reality, where the systems/ mechanisms exists as communication tools which breaks down the patterns of bio-mechanisms using electromagnetic signals and artificial intelligence.

Image taken at DAAD Gallery, Berlin

Micro-Rhythms, 2016

“Micro-rhythms is a bio-driven installation where small variations in voltage inside microbial cells generate combining arrays of light patterns. A pattern recognition algorithm detects matching sequences and turns them in to sound. The algorithm written in Python uses three Raspberry Pi cameras with Open Computer Vision to track light changes creating a real-time graphic score for an octophonic audio system to be played with SuperCollider. The cells are fuelled using soil samples from every place where the piece is presented, growing harmless bacteria that clean their environment and produce the micro signal that detonates all the processes in the piece. Understood as an interspecies system, the installation amplifies the microvoltage produced by these microscopic organisms and transduces their oscillations into pure electronic signals with which they create an audiovisual system that evokes the origins of coded languages.”

MICRO-RHYTHMS [2016]

Speculative Communications, 2017

“A machine that can observe and learn from a microorganism and uses the data arising from its behavioural patterns as a source of composition for an audiovisual score. This project is focused on the creation of an artificial intelligence that has the ability to identify repeated coordinated actions inside biological cultures. The AI stores and transforms these actions in to events to which it assigns different musical and visual gestures creating an auto-generative composition according to the decision making logic it produces through time. To accomplish this we will development an analog signal collector and transmission device able to perform its own biological maintenance and an audiovisual platform allowing the expression of these biological signals. The resulting composition will be transmitted live via a server channel where the coevolution process can be monitored in real time. Inspired by research centres such as SETI (Search for extraterrestrial intelligence), Speculative Communications is part a research space for non anthropocentric communication and part a non-human intelligence auto-generative system.”

SPECULATIVE COMMUNICATIONS [2017]

 

The artistic approach of generating communications through audio-visual means between non-human organisms  is novel to me. The gathering and processing of data using machine learning algorithms and artificial intelligence and the real-time generation of light and sound through the signals serves as a new way for us to understand these forms. The choice of output may be biased to us as humans but do these non-human forms see a need to communicate? Nevertheless, I think INTERSPECIFICS’ paradigm of work is experimental and innovative, the methodological approach focused on their point of interest in Bio-technology (bacteria, plants, slime molds) and creating a communicative link between humans and non-humans through ‘machines’ – a culmination of  scientific knowledge and computer systems.