A Networked Hybrid Interface for Audience Sonification and Machine Learning

Abstract

Lick the Toad is an ongoing project developed as a web based interface that runs in modern browsers. It provides a custom made platform to collect user data accessed from mobile devices, such as smartphones, tablets etc. The system offers a tool for interactive collective sonification supporting networked music performance. It can be used in various contexts, such as an onsite installation, or for the distribution of raw data for live coding performances making it a versatile component for an array of creative practices. Of these, live coding which is one of the author's artistic approach to create live performances is demonstrated in this article highlighting and elaborating on technical and musical aspects of this approach. Final sections outline the system as a tool for live coding performances and cover a series of potential interactions integrating audience and/or using it independently alike.