The Sarotis Project explores how people interact with the world around them using an experimental soft prosthesis that can sense its surroundings.  It focuses on how spatial awareness is formulated through the procedure of binding spatial information in the body.

In brief, Sarotis is a tactile sensory amplifier prosthetic – a piece of wearable technology designed to expand perception by adding a physical second skin layer. This is imagined using fluidic hydrogel coursing through the soft robotic wearable’s chambers, inflating and deflating sections to recreate physical feedback. Fluids can squeeze chambers to simulate pressure, and theoretically even be heated or cooled to simulate different temperature conditions.

Designers Ava Aghakouchak and Maria Paneta at Interactive Architecture Lab at UCL want us to experience virtual worlds with the additional sensation of the tactile sitting directly over our largest organ: our skin. A partial or full body outfit designed to work in collaboration with a VR head unit, providing tactile feedback of a greater degree than the simple touchscreen haptic feedback offered today.

 

By interconnecting what we see with what we feel, Sarotis aims to improve the immersion factor of virtual reality by coordinated spatial sensation, taking advantage of the human propensity to fill-in the dots of what we experience by the sum of what we sense beyond simply sight.

Soon, we won’t just see imaginary worlds, but we’ll actually know what they feel like through some similar soft interface iteration of Sarotis interacting directly with our skin.

PROS:

1. Prosthesis so far involves hard materials in structures that incorporate special sensing equipment. These materials are hard and thus impede the devices’ functionality and the user’s adaptation to the prosthesis. Soft Wearable Prosthesis actuated by Soft Robotics is proposed so as to create an effect on skin that resembles that of human touch. It is better than vibration used currently by the majority of prosthetic devices and its elasticity provides the best fitting on the skin.

2.  As it was investigated by experiments users could become more aware of their surroundings and could also translate inflation patterns into spatial data. They could intensify their spatial experience or even construct a spatial reality without the need to be in a physical space.

CONS:

1. Sarotis uses soft robotics combined with depth sensors to create a prosthetic technology that works in tandem with Google’s Project Tango technology.  However Google’s Tango shut down in March this year. Hence, we are unsure of the changes and direction of this project since it is still in development.

2 . Unable to gauge the durability of the soft prosthetic wearable.

 

Potential Applications:  

Health:

1. It can be useful for the impaired, example the blind and deaf as an alternative form of sensory replacement.

2. It can be used as a sensory enhancement for the elderly when their reactions are slower.  For instance, prewarning them about

Gaming:

1 . With the ability to heighten our senses via our skin, it can be a useful feature for future games (such as VR). Games can be made more engaging and realistic.

 

References:

Binding Softness

The Sartoris Project Explores Amplifying Virtual Reality

https://drivenxdesign.com/now/project.asp?ID=16838

After discussing and figuring out what we needed, we eventually bought the round disc vibration motor from Sim Lim Tower. Comparing both kinds of vibration motors, we felt that the round disc will work better for our wristband as there is a higher surface area of contact on the user than the cylinder one.

   

Firstly, we tried connecting the motors to the Arduino to make sure they work.

At this point, when we run the sketch, all 4 started vibrating at once. As the motors were loosely fixed onto the breadboard, some of the motors flew out of the breadboard after about 2 seconds.

We then tried a few methods on how to programme the motors so that they will only vibrate when activated.

1) Assigning a data call variable to each haptic motor:

Somehow, the data input method did not work. When “a” was pressed, nothing happens and yet the 4 motors continue to vibrate vigorously.

Hence, we revised this version.

2) Making designated keypad functions:

We tried using the keyboard to activate the motors but it seemed to get a little complicated so we opted for a simpler one.

Eventually, we used the SwitchCase method :

However, we realised that when we run the code, with ‘a’ as an input, the code continued to run and activate ‘s’ and ‘z’ as well. It does not stop at ‘a’ alone. After researching for a quite a bit, we added a ‘Break’ function after each call section and it worked!

This is our final code:

 

Simplifying our connections and making of the wristband:

   

  

  

This will be the final look of our wristband: [you can also wear it on your ankle]

Putting on our band:

References:

https://www.arduino.cc/en/Tutorial/SwitchCase2

https://www.instructables.com/id/Interfacing-Buzzer-to-Arduino/

 

What is Monbaby?

Monbaby is a smart breathing and movement monitor for babies. It consists of a smart button attached to the baby’s clothing couple with a mobile application to monitor the baby. 

Why is Monbaby invented? 

Many infants deaths are sudden and unexpected due to accidental suffocation and strangulation in bed. Experts agree that the most important thing that a parent can do to reduce the risk is to place the baby on their back to sleep. 

With traditional monitors, parents may not be alerted in time if their newborn has a stoppage in breathing or has turned over on their stomach to sleep. 

How does it work? 

Monbaby does it by measuring and classifying motion, movements, position, orientation and activity levels and sending it to parents smartphone. It detects breathing and falls and streams data to a smartphone app, where information is displayed in a convenient, easy-to-understand manner.

To detect slightest movements, Monbaby contains MEMS 14bit accelerometer, (MMA8451Q by Freescale) that measures movements, breathing, orientation and activity level. Measurements are done in real-time, 5 times per second and transmitted over Bluetooth (4.0) Low Energy to an iPhone app or any Smart Bluetooth capable device.

The sensor is powered by 3V coin-cell battery giving 3 weeks of constant use and 1 year in passive mode. The antenna operating range is 40 in the light of sight.

Parents should attach the button to the baby’s clothing and then activate the app to start the monitoring.

Button:

         

Mobile App: 

 

 

 

PROS: 

  1. It is relatively accurate in detecting and monitoring the baby’s breathing and movements
  2. It is very portable and no other accessories required.
  3. It uses Bluetooth technology so it can still work without WIFI.
  4. The baby does not outgrow the Monbaby device.

CONS:

  1. It will be difficult to use it with a sleeper or rocker that would register movement even if the child has stopped breathing.
  2. However, Bluetooth reliance also means limited range.  In some environments, especially homes with certain wall materials, electromagnetic noise and other obstructions, the range of the device may at times be more limited than in the vast majority of homes.

Modifications: 

  1. It can add on an air quality detection feature to see if the surrounding air quality is safe for the baby. This can be a potentially safe feature to detect the slightest change in the air quality, for e.g. gas leakage

 

References:

Wearable Baby monitors: What’s all the Buzz?

https://www.cnet.com/reviews/mondevices-monbaby-smart-button-review/

https://monbaby.com/#what-is

 

 

 

 

 

 

 

 

 

 

 

 

 

PARO, the”CAREBOT”:

                           

What is it about?

Paro, the therapeutic seal marketed as a “carebot,” was designed specifically for the elderly, especially for those with dementia. It is an advanced interactive robot developed by AIST, a leading Japanese industrial automation pioneer. Paro is a socially responsive robot that reacts to the individual in response to the way in which it is treated as they follow social behaviour and rules. It weighs approximately 6 pounds (2.73kg) much alike to a baby seal.

Why was it created?

Animal-assisted therapy is perhaps the best-known form of recreational therapy in the aged care setting. Studies suggest that animal-assisted therapy reduces depressive symptoms and agitation and results in an overall positive experience for the elderly. As a result, robots, and particularly pet robots, have arisen as a viable alternative.

How does it work?

A baby harp seal spends most of the day sleeping. However, PARO has a diurnal rhythm of morning, daytime, and night. For example, PARO is active during the daytime, but gets sleepy at night.

PARO has five kinds of sensors: tactile, light, audition, temperature, and posture sensors, with which it can perceive people and its environment. With the light sensor, PARO can recognize light and dark. He feels being stroked and beaten by tactile sensor or being held by the posture sensor. PARO can also recognize the direction of voice and words such as its name, greetings, and praise with its audio sensor.

PARO can learn to behave in a way that the user prefers, and to respond to its new name. For example, if you stroke it every time you touch it, PARO will remember your previous action and try to repeat that action to be stroked. If you hit it, PARO remembers its previous action and tries not to do that action.   By interaction with people, PARO responds as if it is alive, moving its head and legs, making sounds, and showing your preferred behaviour, imitating the voice of a real baby harp seal.

 

PROs:

#1) It allows the documented benefits of animal therapy to be administered to patients in environments such as hospitals and extended care facilities where live animals present treatment or logistical difficulties. There is no need to feed, walk or clean up after the robot and it doesn’t come with the risk of biting or unpredictable behaviour.

#2) PARO has been shown to have a psychological effect on patients, improving their relaxation and motivation and hence reduce patient stress between them and their caregivers. The emotional benefits extended to providing happiness and comfort at the end of life. This is especially significant for elderly who had been exhibiting disruptive, loud behaviour. They became more relaxed, contented, and settled for a period of time.

#3)  Reduced loneliness has been identified as a benefit of Paro with the establishment of a direct relationship with the robotic seal and its use in facilitating better social connections with others. Isolated and withdrawn residents talked to Paro in a conversational manner and elderly reaching the end-of-life stage verbalised their internal world,  seemingly reducing a sense of being alone.

 

CONS:

#1) While robotic pets can offer a novelty in the beginning, over time, the spontaneity goes away. That’s because the owner has to engage the robot to respond versus a live animal who can innately and intuitively read a person’s emotions and give him or her a lick on the hand or set its head on a lap. This may not be useful for completely immobile elderly.

#2) They “learn” in very limited ways, according to pre-designed algorithms. They respond in pre-programmed ways, with little room for on-the-fly decision making.

#3) The battery runs out quickly and has to be recharged often through the seal’s pacificer. There was a suggestion that some residents with dementia appeared to lack the understanding that it was not real and truly believed that a live seal has come to live with them. Some felt that this can be an ethical implication where Paro can be emotionally deceiving.

 

Similar adaptations in Singapore: 

Meet HUGGLER from Singapore: 

             

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

This stuffed monkey can laugh, grunt and whine depending on where it’s touched, and Agency for Science, Technology and Research (A*Star) researchers hope to use it as an alternative to pet therapy to improve quality of life for the elderly. The idea is to offer a tactile companion for elderly patients, while monitoring for risks of Alzheimer’s and dementia.

Developed in Singapore, the Huggler is currently on trial at the St Luke’s Eldercare Hospital, in the north of the island. Huggler can engage the elderly where traditional stimulation can’t, and alert caregivers to moods in an unobtrusive way. The robot tracks how people are interacting with it, picking up on both physical actions (how hard a person squeezes, say) and the noises they make. This data is then fed into a “sound-event classification” system that assesses the hugger’s state of mind. The use of HuGGler will also provide clinicians with reports related to the interaction behavior pattern of the users performed towards the robotic platform.

“The current method of monitoring the mental well-being of elderly is based on manual observation and questionnaires that are very subjective,” wrote Tan Yeow Yee, one of the developers, in an email. “We can use Huggler to monitor and provide the information to geriatrician to allow them to make more accurate deduction.”

 

Evaluation: 

Personally, I find this a very useful interactive device that can act as an alternative companion for the elderly especially for those who are suffering from dementia. In Singapore’s context where we face a rapidly aging population, this device may come in particularly useful.

Like the Huggler, perhaps Paro can be improved with added on abilities such as:

  1. Heart rate monitor to be activated when the elderly is hugging Paro (or Huggler) and data to be sent to caregivers.
  2. Beeping alert system for caregivers as reminders for the elderly to take their medication at regular intervals.

The interactive device can also be modified to fit other age groups such as for young children. It can be paired with a mobile application where data about the interaction can be collected and sent via the application for parents to monitor their children’s behaviour and better understand them.

References:

Research Article: Robotic Seals as Therapeutic Tools in an Aged Care Facility: A Qualitative Study By Melanie Birks, Marie Bodak, Joanna Barlas, June Harwood, and Mary Pether

Research Article: The ethical implications of using PARO with a focus on dementia patient care https://pdfs.semanticscholar.org/ec2e/5cc752693539c640347450882509e1d32653.pdf

https://youtu.be/oJq5PQZHU-I (PARO ROBOT URL)

https://www.fastcompany.com/3019678/this-huggable-monkey-robot-will-make-you-feel-better-about-the-world

http://www.huggler-pet.com/about/

https://nurse.org/articles/nurse-robots-friend-or-foe/

https://www.city.ac.uk/news/2017/june/can-robots-help-care-for-people-with-dementia

https://www.psd.gov.sg/challenge/ideas/deep-dive/living-and-working-alongside-robot-buddies

http://www.parorobots.com/photogallery.asp

https://www.nextavenue.org/robotic-pets-good-real-pets/

http://www.kalw.org/post/robotic-seals-comfort-dementia-patients-raise-ethical-concerns#stream/0

https://www.straitstimes.com/asia/robot-exercise-coach-for-the-elderly-5-other-robotic-helpers-that-make-ageing-easier

 

 

 

 

Smart Kitchen:

This week’s exercise on sketch-appbodyspace will be on adapting radio layouts and having an altered modality on objects.

#Radio Device 1: KITCHEN HOOD

The kitchen hood will act as the speaker for the radio.

 

#Radio Device 2: SOUP LADLE

The speed of your stirring will determine the speed of the music played in the kitchen.

 

#Radio Device 3: FRYING SPATULA

The impact / force on the frying pan from the spatula will determine the volume. How hard you fry determine the volume of the radio from the kitchen hood (speaker).

 

#Radio Device 4: POT 

With every new ingredient added into the pot, a new song will be added to the playlist.

 

#Altered Modality: CUTTING BOARD

There will be a light stip on the top of the cutting board, it will light up when any cutting motion is detected. When it senses that there is a safe distance from the knife to the fingers, the strip will be green. As the knife gets closer to your fingers, it will gradually turn to amber and then to red (danger zone).

A beeping sound function will also be activated. When the light turns amber, there will be a light beeping sound. As it gradually turns to red, the beeping sounds get louder and louder much like a car reversing detection system.

HUMAN TRAFFIC LED Project:

This project is made for ilight event participants where they can attach a LED strip on their bags to indicate the direction they are moving towards. There will be 2 contact points for right and left respectively. When the user touches the right contact point, the LED will light up in green signaling right and vice versa for the left contact point (very much alike to car signals). When both contact points are touched, the LED turns red to signal the stopping motion of the participant.

This project can also be implemented in other scenarios such as: Teachers bringing young students out for learning journeys or tour guides conducting tours. The teacher or the tour guide can also place this LED strip on their bags or flag (sometimes board) to signal the direction they are moving towards without shouting all the time.

PROCESS:

Initially we tried to experiment the capacitive touch with aluminum foil via led bulb first using <CapacitiveSensor.h>.

 

Then, we moved on to using 2 LED bulbs to simulate the left and right capacitive sensors.

After which,  the code was modified to accommodate the LED strip and each contact point is made to light up the led strips in either direction with <FastLED.h>.

The led strip is supposed to light up in red (to represent the stopping motion of the user) when both contact points are touched. However, in this case, there is a glitch whereby the green colour is still lighted up followed by the red.

Hence, we did some adjustments and the corrections seem to rectify the errors!

This is our code:

For ease of usage, we extended the resistor touch points using wires and aluminium foil.

We also made “control sticks” to make it more user-friendly.