An Interactive Solution for Enhancing the Digital Communication Experience:
Zoom +
This project proposes a more interactive Zoom experience with additional productivity and social communication tools via machine learning.
machine learning ✔human computer interaction ✔experience design ✔
About This Work
A phenomenon known as “Zoom Fatigue” has surfaced, a worry or burnout associated with overuse of digital communication platforms. Zoom + uses machine learning and a webcam to interprate body language cues and react with appropriate expressions.
-
OBS studio, Processing, P5.js, Teachable Machine
-
Yumih Chang- Prototyping, Design
Hyunmyun Yang ‘21- Prototyping, Design
Lucy Du ‘21- Prototyping, Video Editing
Productivity Tools
Currently, Zoom allows the user to upload a single image or video background. Zoom + adds functionality to the background by incorporating a real-time, interactive canvas.
-
Allows the user to change their background in real-time to reflect their mood or preference
-
Allows users to draw on their background canvas. This can be useful for taking notes, doodling, or for self expression.
-
Allows users to share a background image. This can be useful for collaborative brainstorming.
Communication Tools
Zoom is limited in reactive features. Zoom + allows users to upload their own gif or images to react with and features a collection of camera filters.
-
Users can upload their own images, gif and emojis and place them on their screen by clicking on the canvas.
-
A machine learning model was trained on various poses which act as triggers to broadcast various reaction images.
-
Webcam filters can be applied for privacy or for taking a break from being in front of the camera.