I fabricated the controller and programmed it with a media controller Sprite for the interaction.
Tools: Arduino, Sprite, Projector, Laser-Cutter, After Effects, Premiere, Illustrator
Skills: Projection, Experience and Interaction Design
Time: Jan. 2020
Instant gratification from phones seems to be more tempting than being present at face-to-face conversations. With constant access to the world in our pockets, where should we direct our attention while trying to be present in the moment?
Most of us are guilty of being distracted by our phones during face-to-face conversations. Yet it seemed to be embedded in our culture. Even when we are not using our phones, we are being distracted. (link)
We want to point out the digital culture of the phone in the form of interactive video sculpture to make people more aware of their relationships with loved ones and their phones.
During our brainstorming process, we had several ideas, most of which are involved with people being controlled by the things they own.
Our goal is to create a portraiture in the form of interactive video sculpture. We then focused on telling a story of a modern relationship between people and their phones.
We then thought of using light as a way of representing the strength of their connection.
We wanted to show how human interactions would change the relationship for the people in the video. For our concept, using a phone is very intuitive as the interaction device for the user. Different interactions such as swiping, picking the phone up, would indicate changes in the relationship depicted in the videos.
The video footage of the couple was created by Dina and Patrick. The background of the video was influenced by the following image from a game called the Red Strings Club.
We then created a modern dating environment using after effects as shown below.
Still from video one when the couple is having a good time chatting.
Dina and Patrick worked on filming and after effects to illustrate the idea.
As the creative technologist in the team, I compiled the code for our hardware in Arduino, fabricated the phone/enclosure for the electronics, and worked with Sprite MedeaWiz (a triggered video repeater for compact video projection).
We chose to work with Sprite for our project for several reasons:
For the code, I used the Accelerometer and Arduino Uno to determine if the phone is up or down. I added the button as another condition to trigger the third video.
You can look at my code here . I used the library for the accelerometer Arduino_LSM6DS3.h
I fabricated the phone which functions as an enclosure as well using plywood and standoffs as below. I designed the phone in Illustrator and laser cutted it and assembled the pieces.
Here is our take on how a modern relationship between a couple is portrayed.
Special thanks to Patrick Warren, Dina Khalil, and Hyunseo Lee.
Addressing identity issues in society through 100 days of exploring on Spark AR platform.
Skills: Spark AR, Blender, and Unity
A virtual experience that invites people to relive, rethink, and reflect their responses/ their change of behaviors towards the toilet paper mania during COVID-19.
Skills: Blender and Unity
Talk about your feelings to get through hard times.
Tools: Front-End,Javascript, HTML5, CSS, Github, Heroku, p5.js, p5.speech
An interactive music installation that reinterprets the daily mundane sounds.
Skills: Kinect, Max/Msp, Max for Live, Ableton, Composing
A light visualization of historical rain data of cities around the globe.
Skills: Arduino, Wifi, HTTP request, JSON parsing, API
An audiovisual performance echoing the feeling of voidness and the draining of energy while living through the COVID-19.
Created under 6 hours for PerformaJam LIVE - CultureHub and Adjacent Jounral.
A personal Apple watch band that keeps you warm in the cold.
Skills: Design Research, Market Analysis, Fabrication, Art Direction
A website offers food options based on user emotions.
Tools: HTML5, CSS, Javascript, Node.js, Database, MongoDB, Github, Heroku
An interactive game to learn recipes visually.
Skills: Fabrication, Physical Computing, Creative Coding
An interactive video sculpture exploring the relationships between humans and phones.
Tools: Arduino, Sprite, Projector, Laser-Cutter, After Effects, Premiere, Illustrator
An interactive video sculpture that exposes the systems of the Internet in real-time.
Skills: Projection mapping, MadMapper, Processing, Syphon Recorder, Real-Time Performance