Multi-lingual audio-visual collaboration

In this workshop, we will demonstrate and collectively explore numerous different approaches to collaborative audio-visual live coding, taking particular advantage of the multiple languages targeting visual output within the Estuary collaborative live coding platform. As this platform unites heterogenous languages within a single, zero-installation, web-based platform, it is particularly well-suited to collaborative work between musicians and visualists (as well as people who are both musicians and visualists!). Synchronization, data sharing, and ensemble transparency (the ability to see what others are working on) are default starting conditions with Estuary, rather than “special features/modes”. The development of languages targeting visual outputs has been a particular focus of recent work within Estuary. The Punctual language allows WebGL fragment shaders to be created from economical Haskell- like notations that can also, simultaneously, be translated into Web
Audio API graphs and sound output. The CineCer0 (pronounced “sin–ay– ser-oh”) language allows video files to be projected temporally and geometrically, targeting similar functionality to that of CineVivo, again with an economical Haskell-like notation. An even newer, third graphics language within Estuary is projected to be available for this workshop, modelled on The Force and like that environment making it possible to write fragment shaders in “raw” GLSL.
All of the above languages can be used simultaneously within the networked collaborative interfaces provided by Estuary, and as such, in close connection with other languages that target sound output more exclusively. This is strongly supportive of experiments with different ways of relating sound to visuals and vice versa, and consequently doing such experiments collectively will be a core activity within the workshop.

Participants are strongly encouraged to bring their own laptops with either the Chrome or Chromium browser installed, as well as some type of headphones for the headphone jam. No previous experience with live coding, Estuary, or any of the languages used here is assumed, so beginners are welcome and will likely take away techniques they can put to use immediately. At the same time, the workshop’s focus on an emerging area of interest in live coding research (better understanding the possibilities of combined audio-visual work) will hopefully provide something to challenge any live coding “veterans” in the group. https://intramuros.mcmaster.ca (Estuary, use Chrome/Chromium) https://dktr0.github.io/Punctual (Punctual, use Chrome/Chromium)

Details

Register