[Interactive 2] Exercise 2 – Eye

An image on the screen that follows you whenever you move either left or right. It responds to your position as you gaze as the image.

The Original

How It Works

Step 1 : Face Tracking
Firstly, image/face tracking needs to be applied to capture the position of the user’s face. jit.grab is used to get image from the camera then cv.jit.faces is used to draw a bounding box is around the face.

Step 1Since the central point of the bounding box is needed to identify the position of the face, the width is divided by 2. The face recognition should be 320 by 240 for a fixed resolution. If normalized, 0 to 1 is used (where 0.5 is the middle value).

Step 2 : Make the Video/Asset
Then, a video is created as an asset by using the playback function. There are various ways to do this such as playlist, jit.qt and jit.movie.

Step 3 : Convert (x, y) Coordinates to the Frame
The main concept of this assignment : one coordinate gives you a frame. Therefore, a scale is used to map the input range of float values to the output range. A slider is placed as well to visualize the values better.
screen-shot-2017-02-07-at-3-39-40-pm step2

The steps for this assignment was quite straightforward : make the asset, apply playback, track the face, and integrate (how to go from x, y to frame). However, the tricky part was to convert the coordinates values to frame number. I realized that the longer the asset is (in terms of frame numbers), the smoother it gets.

The only problem I had that I could not solve was to make the video stop when the (x, y) is (0, 0) : as there was no face detected. Otherwise, the frame will jump abruptly to the first.

The Interaction

*No worries, no pet was abused in the process!

Published by


Believes in creating works that someone can not only see or touch but be part of, to be within them.

Leave a Reply