REACT
Download Project Doc 🔗 (PDF | 4 MB)
An interactive visual experience transforms the act of hitting drums into a captivating display.
As drums are played, users watch how sound translates into dynamic visuals, creating an inclusive and engaging environment for all participants. We aspire to bridge the gap between sound and visuals, ensuring that this experience resonates with everyone, irrespective of their hearing abilities!
Prompt
Using new media, tell the origins of something while integrating a cardboard box.
Software
TouchDesigner, Nintendo Wii Harmonix Wired Drum Set 19092
Timeline
6 weeks
My Role
As the Team Lead, I orchestrated the timely completion of primary project milestones, managed file organization, and took charge of additional project components, including crafting the logo, creating the process reel, and compiling our final project document. I collaborated with four talented designers from the New Media Design program: Miles, Lexi, Abe, and Terry.
Something Special
Working with Abe and Terry, both deaf students, presented a remarkable opportunity for personal growth in my communication skills. This challenge turned out to be what set our project apart. Not only were Abe and Terry awesome collaborators, offering valuable insights and ideas, but their unique perspective on our project pertaining to music deepened my understanding of the profound impact design and accessibility have.
Our Starting Point
Though our concept strayed a bit during the process, we found our way back to this similar concept in the end; we enjoyed that full-circle aspect! We started by exploring the concept of visualizing different genres of music. Each group member did a deep dive into one specific genre and captured the mood and visual style of them.
We ultimately adopted a similar visual style as EDM, tying in our initial process work from the start of our project with our final result!
Experimentation
We spent a lot of time trying out different concepts. Here’s a look:
Our Build Plan
After many, many structure ideas, this became the final plan!
Building The Structure
A peek at our crazy (fun) process...
Using lots of cardboard from boxes, glue, and questionable box cutters, we constructed this structure. We made a box to contain the projection, using other boxes. It’s called “The Box Project,” after all! To hang, we used good old command strips.
Where We Ended Up
After tons of ideation, experimentation, building, and teamwork, we finally landed where we needed to be.
How Does It Work?
In TouchDesigner, we programmed visuals to respond to song input. Using a Nintendo Wii Harmonix Wired Drum Set, we configured the TouchDesigner file to recognize each drum pad as a keyboard key. When hit, each pad triggers specific visual effects, allowing users to play the drums and observe their impact on the visuals.
Here's the TouchDesigner file itself, showcasing the visuals projected onto the wall. These are the captivating images users experience while playing the drums!
Want To See It In Action?
Check out this video of the Design Director at RIT showing his talents during our showcase!
Project Overview
Let's sum up this awesome process with a reel that I created in Adobe After Effects!
Like what you see?
Check out the Project Doc here 🔗 (PDF | 4 MB)
