By Audrey and Yuki
Link to slides: https://docs.google.com/presentation/d/12sFglOa5tGBjqf53XhsYFzlUAbH9UVglFemNnJEDIiQ/preview
Semester Project – Flower Bed
Leave a reply
Category Archives: 21S1-DM3014-INTERACTIVE DEVICES
DOW – Senses : Theremin
DESCRIPTION
Theremin can be seen as an instrument you play by not touching it, and is played by manipulating the electromagnetic fields around the instrument’s two antennae. Players move theirs hands near the antennae to raise or lower the pitch and volume. The sounds can be seen as operatic. It can be seen as creating audio through proximity.
PROS
Unique instrument, using spatial perception to play
Characteristic sound of theremin
Works well with other instruments, as duets, ensembles and even as a soloist
Scalable pitch
Shift in volume both gradual and sudden shifts are relatively easy to achieve
Staccatos are also possible on theremin
CONS
Definite pitch and volume is not allocated and most likely to be played through experience and muscle memory of spatial perception
Learning curve, once of the most difficult instruments to play well
Monophonic instrument, only able to produce one pitch at a time, no chords
VIDEO
REFERENCES
https://electronics.howstuffworks.com/gadgets/audio-music/theremin.htm
DOW – IoT : SKYME Owl Robot Pet Camera and Treat Dispenser
DESCRIPTION
Skyme Owl Pet Camera and Treat Dispenser is a interactive device allowing owners to interact with their pets wherever they are. It can be remotely controlled with an app, two way audio allows communication with pets and able to dispense treats.
PROS
Super interactive with your pet (move around, feed and two way audio)
Wake up function allows automatic interaction with pet once they touch the robot, keep it active
Accessible with app with multiple users, wherever users are
Great for checking in and accompanying pets, movable surveillance
Video recording with HD camera with night vision
CONS
Relying too much on robot for pet’s mental stimulation
Expensive (Around $200), compared to $20
Mental stimulation for pet is limited (chasing, following of robot)
Overfeeding of pet
VIDEO
REFERENCES
Skymee Owl Robot Pet Camera & Pet Treats Dispenser
Skymee Owl Robot: Mobile Full HD Pet Camera with Treat Dispenser, Interactive Toy for pets via App
DOW – Health : Ring fit Adventure RING CON
DESCRIPTION
Ring con is an device that comes along with Ring Fit Adventure, an exercise action role-playing game. It accompanies the Nintendo switch controller to support (or augment) for better performance and also do the gestures needed in the game, especially pressing in and pulling of the ring con which are one of the few main mechanics of the game. These movements correspond along with the avatar in the game.
PROS
Ring con is sturdy (made of fibre-glass reinforced plastics in spring)
Allows the player for better exercising (more balanced, straightening) and various exercises (from stretching, running, yoga poses, working of arm muscles)
Allows Nintendo switch IR motion sensor to become a heart rate monitor, able to track estimated pulse rate
Allows working out at home and injecting fun to your workout!
Adjust intensity, exercises developed with the help of fitness advisors
CONS
EXPENSIVE ($100+ base price)
Needs to house a Nintendo controller in order to function
Game requires ring con and leg strap in order to play (hence, the need to buy a physical version of the game)
VIDEO
REFERENCES
https://superbusymum.net/is-ring-fit-adventure-nintendo-switch-review/
https://ringfitadventure.nintendo.com/
Semester Project Proposal – Flower Bed
Group with Audrey
Link to slides:
https://docs.google.com/presentation/d/1iqPTXqMUHLYpQiOFssWmBj-sKUHz9bckbH0KoXyIwtU/preview
Sketch 4: AR (Ideation and Low Prototype)
PDF verison: Sketch4
Sketch preview on AR.
Paired up with Audrey and we decided to go towards the hide and seek idea, envisioning markers around a space and you have to find them to find your digital friends! Wanted to further expand what was learnt in class, from triggering the visibility of the face filter, to triggering a “found” function instead, to show you found the digital character (also played around with the particle system). Decided to go for an Easter egg hunt theme for this low prototype, where you have to click on the egg to show you found the bunny (with the egg unable to be triggered back on again even tapping the screen the second time).
The thought of AR got me thinking of how it kind of combines or ties fictional and reality together, and in a sense brings life to objects. This to me kind of blurs out that line giving this grey area where we can interact with these digital objects as if they exist. So with that, it was the exploration of ideas on how using this grey area, whether the need for objects be it real life or digital.
Further improvements can be:
Multiple targets (more characters)
Implementation of animated 3D characters (more immersion)
Scoring system or number system (show number of characters found, or characters that left to be found)
Sketch 3: Multimodal (Ideation and Low Prototype)
PDF version: Sketch3
Sketch preview on ring device.
Paired up with Audrey and we decided to go towards the touch ring idea. Combining her script on communication from processing to arduino by serial, I was able to stimulate the ring using 3D touch in zigsim, showing how the ring at the receiving end would show the respective led light colours.
Sending one’s state of mind got me thinking of conversations, and how putting thoughts to words was always a challenging process to me. Especially after an awkward conversion, or after a spat with a loved one, making the first move to reconcile or continue the conversion would be very hard so the idea of a device to assist such moment comes to mind.
Further improvements can be:
Types of touches can be further explored/experimented (double tap, swipe)
Types of the feedback can be further explore/experimented (audio, light colour or sequences/patterns)
Sketch 2: Gestures (Ideation and Low Prototype)
PDF version: Sketch2_pdf
Sketch preview on light device.
Wanted to approach this sketch differently, instead of using hand/pose tracking, I decided to play around with Zigsim as I was not yet familiar with it. With the help of LP’s sample codes I was able to enable communication from Zigsim to processing, to wekinator, and back to processing. Was unable to enable communication from processing to arduino so I used processing to stimulate the feedback of the lights instead.
Device using gestures to control lights, like how a conductor controls depicts how an orchestra plays!
Further improvements can be:
Further feedback can be added audio volume, etc
Further machine learning on wekinator to better identify the gestures
Gestures can be further designed or altered
Sketch 1: Social Distancing Helper
Sketch preview on social distancing helper device.
Light exercise headband help remind wearers and people around them to social distance.
Further improvements can be:
Further feedback can be added to notify when too close, audio etc
Where webcam can be placed/inserted to allow optimal face tracking
How the leds are incorporated onto the headband
Social Distancing Helper – Ideation
PDF version: sketch_social_distance
