Work Experiments About Classes

Double Date - Video Sculpture

An interactive video installation about attention between devices and people.

Highlights

I fabricated the controller and programmed it with a media controller Sprite for the interaction.

Tools: Arduino, Sprite, Projector, Laser-Cutter, After Effects, Premiere, Illustrator

Skills: Projection, Experience and Interaction Design

Time: Jan. 2020

Problem Statement

How might we make people aware of their relationships with loved ones and their phones?

Concept

Instant gratification from phones seems to be more tempting than being present at face-to-face conversations. With constant access to the world in our pockets, where should we direct our attention while trying to be present in the moment?

Role

  • Developer
  • Fabricator
  • Post-production

Research

Most of us are guilty of being distracted by our phones during face-to-face conversations. Yet it seemed to be embedded in our culture. Even when we are not using our phones, we are being distracted. (link)

We want to point out the digital culture of the phone in the form of interactive video sculpture to make people more aware of their relationships with loved ones and their phones.

Ideation/Exploration

interaction graph of phone, sprite, projector, and the restaurant panel.

During our brainstorming process, we had several ideas, most of which are involved with people being controlled by the things they own.

Our goal is to create a portraiture in the form of interactive video sculpture. We then focused on telling a story of a modern relationship between people and their phones.

Inspirations:

We then thought of using light as a way of representing the strength of their connection.

  • When a couple is engaging in conversations, the light above them is bright.
  • When one is looking at the phone, the light is half bright.
  • When both are looking at the phones, the light dims.

Development

We wanted to show how human interactions would change the relationship for the people in the video. For our concept, using a phone is very intuitive as the interaction device for the user. Different interactions such as swiping, picking the phone up, would indicate changes in the relationship depicted in the videos.

Determine the interaction:

  • phone face down → play video one of the couple having a great time
  • phone is flipped to face up → play video two of the girl playing on the phone
  • button is pressed → play video three of the couple on the phones, giving attention to the digital others

Determine the presentation form:

The video footage of the couple was created by Dina and Patrick. The background of the video was influenced by the following image from a game called the Red Strings Club.

We then created a modern dating environment using after effects as shown below.

Still from video one when the couple is having a good time chatting.

Videos for Interactions

Dina and Patrick worked on filming and after effects to illustrate the idea.

Refinement and Testing

Programming & Fabrication

As the creative technologist in the team, I compiled the code for our hardware in Arduino, fabricated the phone/enclosure for the electronics, and worked with Sprite MedeaWiz (a triggered video repeater for compact video projection).

We chose to work with Sprite for our project for several reasons:

  • It is compact for physical installation
  • It can be controlled by Arduino

For the code, I used the Accelerometer and Arduino Uno to determine if the phone is up or down. I added the button as another condition to trigger the third video.

schematics for the installation with arduino, accelerometer, pushbutton, led light, and a 220Ω resistor.

You can look at my code here . I used the library for the accelerometer Arduino_LSM6DS3.h

I fabricated the phone which functions as an enclosure as well using plywood and standoffs as below. I designed the phone in Illustrator and laser cutted it and assembled the pieces.

Solution

Here is our take on how a modern relationship between a couple is portrayed.


Special thanks to Patrick Warren, Dina Khalil, and Hyunseo Lee.

AR, 3D Model, 100 days

Extensions of Ourselves - AR Filters

Addressing identity issues in society through 100 days of exploring on Spark AR platform.

Skills: Spark AR, Blender, and Unity

Interactive VR Experience

Toilet Paper Mania - Immersive VR Museum

A virtual experience that invites people to relive, rethink, and reflect their responses/ their change of behaviors towards the toilet paper mania during COVID-19.

Skills: Blender and Unity

UX, UI, Web

Audio Diary - Front-End Web

Talk about your feelings to get through hard times.

Tools: Front-End,Javascript, HTML5, CSS, Github, Heroku, p5.js, p5.speech

Interactive Exhibition, Generative Music

Forest of Sounds - Interactive Music Exhibition

An interactive music installation that reinterprets the daily mundane sounds.

Skills: Kinect, Max/Msp, Max for Live, Ableton, Composing

Installation

Dance of the Rain - Light Visualization

A light visualization of historical rain data of cities around the globe.

Skills: Arduino, Wifi, HTTP request, JSON parsing, API

Live Performance, Music, Art

A Day, Any Day, Everyday - Live Performance

An audiovisual performance echoing the feeling of voidness and the draining of energy while living through the COVID-19.

Created under 6 hours for PerformaJam LIVE - CultureHub and Adjacent Jounral.

Product Design, Wearable Tech

Zeal - Product Design

A personal Apple watch band that keeps you warm in the cold.

Skills: Design Research, Market Analysis, Fabrication, Art Direction

UX, UI, Interaction Design, Fullstack Web

Mood for Food - Fullstack Web

A website offers food options based on user emotions.

Tools: HTML5, CSS, Javascript, Node.js, Database, MongoDB, Github, Heroku

UX, UI, Interaction Design, & Product Design

Authentic or Not - Interactive Cooking Game

An interactive game to learn recipes visually.

Skills: Fabrication, Physical Computing, Creative Coding

Experience Design & Interaction Design

Double Date - Video Sculpture

An interactive video sculpture exploring the relationships between humans and phones.

Tools: Arduino, Sprite, Projector, Laser-Cutter, After Effects, Premiere, Illustrator

Experience, Interaction Design, & Performance

All Connecting - Video Sculpture

An interactive video sculpture that exposes the systems of the Internet in real-time.

Skills: Projection mapping, MadMapper, Processing, Syphon Recorder, Real-Time Performance