INTERACTION DESIGN PROJECTS

01 Bullet time camera array | 02 unity interactive music video | 03 tensorflow interactive story


01 Little Falls | Bullet Time Camera Array Beta Development

TOOLS: Adobe After Effects | Unity Game Engine | Blender.

ROLE: Creative researcher.

DATE: Spring - summer, 2022

CONTEXT: Special project in collaboration between the Art&Technology bachelor’s Emerging Technologies program, and an NDA protected client seeking creative development. At the close of the program, I continued working independently into the summer with the professor, earning the Little Falls Award for Excellence for my contribution.

 
 

The Little Falls project was introduced as a part of the final year Art&Technology bachelor’s program course, Emerging Technologies. An NDA protected company asked us to help them come up with creative directions to take a camera array project. A team of four students—my close friends and I—continued working on the special project with our professor and partner company beyond the conclusion of the course until our final term. One concept that we had a lot of fun with was “Anja’s Bike.” We strapped the camera array, a generator, and laptop to the back of our professor’s pickup truck, and took turns filming and processing while I biked through the beautiful Pacific Northwest. My key contribution to this phase of the project as a whole was “Mary’s Dragon,” a three dimensional model that I placed in Mary’s hand using Unity Game Engine in post production. Using the same coordinates as the physical setup, I replicated the physical camera array using cameras in Unity, and placed a dragon model in the same digital location as Mary’s hand. That summer after graduation, I continued working independently with the professor on this project, notably on “Chad’s Poem,” a three dimensional signed poem with After Effects animated 3D subtitles for which I earned the Little Falls Award for Excellence.


UNITY Interactive music video

View the full video here! This interactive music video was created using Unity and Blender. The player can walk through a dusty desert landscape, and approach a mysterious singing relic while dancing particles move in time with the music.


Tensorflow interactive story | Hogeschool van amsterdam + Rathenau instituut

The Rathenau Institute is an EU founded member of the European Parliamentary Technology Assessment. Digital Society School at the Amsterdam University of Applied Sciences facilitated our creative research partnership.

Using SCRUM methodology, as the “Tools and Instruments Master,” I was responsible for interactive prototyping in Figma, and executing final motion-capture design by training AI pose models in Teachable Machine.


Our ambition: to conduct creative research into the effect of new technology on underrepresented communities. We partnered with the Amsterdam Public Libraries to test prototype iterations with community while managing stakeholder feedback.