In this workshop, we will demonstrate and collectively explore
numerous different approaches to collaborative audio-visual live
coding, taking particular advantage of the multiple languages
targeting visual output within the Estuary collaborative live coding
platform. As this platform unites heterogenous languages within a
single, zero-installation, web-based platform, it is particularly
well-suited to collaborative work between musicians and visualists
(as well as people who are both musicians and visualists!).
Synchronization, data sharing, and ensemble transparency (the ability
to see what others are working on) are default starting conditions
with Estuary, rather than “special features/modes”.
The development of languages targeting visual outputs has been a
particular focus of recent work within Estuary. The Punctual language
allows WebGL fragment shaders to be created from economical Haskell-
like notations that can also, simultaneously, be translated into Web
Audio API graphs and sound output. The CineCer0 (pronounced “sin–ay–
ser-oh”) language allows video files to be projected temporally and
geometrically, targeting similar functionality to that of CineVivo,
again with an economical Haskell-like notation. An even newer, third
graphics language within Estuary is projected to be available for
this workshop, modelled on The Force and like that environment making
it possible to write fragment shaders in “raw” GLSL.
All of the above languages can be used simultaneously within the
networked collaborative interfaces provided by Estuary, and as such,
in close connection with other languages that target sound output
more exclusively. This is strongly supportive of experiments with
different ways of relating sound to visuals and vice versa, and
consequently doing such experiments collectively will be a core
activity within the workshop.
Participants are strongly encouraged to bring their own laptops with
either the Chrome or Chromium browser installed, as well as some type
of headphones for the headphone jam. No previous experience with live
coding, Estuary, or any of the languages used here is assumed, so
beginners are welcome and will likely take away techniques they can
put to use immediately. At the same time, the workshop’s focus on an
emerging area of interest in live coding research (better
understanding the possibilities of combined audio-visual work) will
hopefully provide something to challenge any live coding “veterans”
in the group.
https://intramuros.mcmaster.ca (Estuary, use Chrome/Chromium)
https://dktr0.github.io/Punctual (Punctual, use Chrome/Chromium)