Collective Musical Sensehacking: Towards Ensemble Sound ARt (2023)
Ensemble musical AR experience
coMuse will enable musicians to develop, design, play, compose, and perform novel and experimental instruments in AR in real time, and collaboratively. For audiences, this may look, sound, and feel like sharing a hybrid perceptual world with another person (or people!). This project builds on findings in polaris~ and polygons~.
Towards an Open-Source Workflow
As part of coMuse I hope to move towards a fully open-source stack for multi-user musical AR experience. Currently, polaris~ and polygons~ both rely on the closed-source game engine Unity. While powerful in its own right, I felt like this next chapter of research might benefit from fully embracing open-source.
The advantages of this lie in the modularity, community, and spirit behind open-source projects. In all likelihood, this will mean moving to:
- Linux from Windows
- Godot from Unity
- Monado / Stardust XR & StereoKit from Project Esky.
- Writing a Godot integration for Project Esky?
Progress will be recorded through development blogs, research papers, and workshops throughout the year.