Music Playback Interface in Augmented Reality

Imagine an augmented reality audio-playback interface that transforms your surroundings into an interactive music studio. Walk around your room and see virtual instruments and effects seamlessly integrated into your space. Adjust EQs with hand gestures, place new loops by grabbing floating icons, and manipulate tracks in a dynamic 3D environment. This immersive interface turns music performance into an engaging adventure, making every session a journey through a landscape of sound.

Personal Project

In Situ AR Concept, Design Ideations

Spacial Design, Visual Design, UI Design, Augmented Reality

A collection of preliminary sketches that capture the early stages of conceptualizing the project. These drawings illustrate how the AR elements would interact with real-world environments.

Each sketch represents a step in exploring design possibilities, spatial relationships, and user interactions. This visual journey highlights the transition from abstract ideas to tangible design solutions.

Below are some rough gesture controls I had created for this project. These controls were based mainly on speculation and current practices.

Clips Control Window

This window lets the user launch and control all the audio/MIDI clips in the session, with the playing clip's waveform color-matched to its channel.

To play a clip, hover and pinch to select, then release to play; selecting and pinching a "play row" button triggers or stops the entire row, and clicking the plus button in the top right adds additional tracks.

Mixer Window

This window presents a Pioneer DJ-style mixer setup with labeled channels and controls.

Adjust EQ knobs by hovering and rotating your wrist while pinching your fingers; the knob changes appearance when not in the default position.

Adjust EQ knobs by hovering and rotating your wrist while pinching your fingers; the knob changes appearance when not in the default position.

Pinch and drag the volume fader up or down to adjust the channel’s volume.

Effects Rack Window

The effects racks closely resembles the one found in Ableton Live, where a user can add different effects and control their parameters using the on screen macros.