Audio Reactive Shaders with Shader Park + TouchDesigner – On-demand

Level: Intermediate: Some previous experience with javascript, or programming is recommended. No experience with TouchDesigner is needed.

Overview

Explore 3D shader programming through a Javascript interface without the complexity of GLSL. Shader Park is an open source project for creating real-time graphics and procedural animations. Follow along through multiple examples using a P5.js style live code editor. Expand upon the examples and bring them into TouchDesigner to create your own audio reactive music visualizers. Explore the Shader Park community gallery where you can fork other people’s creations or feature your own.

Who is the workshop for?

Artists interested in exploring real-time procedural 3D graphics and animations applied as music visualizations.

Developers with experience programming in javascript, a p5.js style library, or similar language is recommended. Bonus if you know shader programming.

By the end of this session a successful student will be able to:

  • Create raymarched 3D shaders with Shader Park

  • Intro to TouchDesigner + Shader Park plugin

  • Overview of audio analysis

  • Create your own audio reactive music visualizer

Session Study Topics:

  • TouchDesigner

  • Shader Park

  • Shaders

  • Raymarching

  • Audio analysis

Requirements

  • A computer and internet connection

  • A copy of TouchDesigner

  • A downloaded song(.mp3 .aif .aiff .wav) you’d like to turn into a music visualizer.

About the workshop leader

Torin Blankensmith and Peter Whidden formed a creative-coding organization while at college together. They hosted weekly workshops for students from various disciplines on emerging topics in computer graphics. It was in this group that the first prototype of Shader Park was developed.

Torin is a freelance creative technologist and adjunct professor at the Parsons School of Design in New York City teaching TouchDesigner and Creative Coding. Based out of NEW INC, Torin creates immersive installations, experiences, interfaces, and websites. Torin’s work explores emerging techniques in real-time graphics pulling inspiration from systems and patterns of emergent behavior in nature. This work has translated into creating large scale environments for medical professionals to alleviate stress/burnout, for patients in clinical studies aiding in neuroscience research on brain recovery, and for commercial spaces bringing sanctuary to the urban landscape.

Peter is a creative software engineer whose work spans physics, astronomy, machine learning, and computer graphics. He currently works at the NY Times R&D lab focused on emerging computer vision and graphics techniques. Previously, Pete has worked with CERN to build interactive 3D visualizations used in particle physics. He’s also developed software with the Data Intensive Research in Astrophysics and Cosmology (DIRAC) Institute which enabled the discovery of over 30 new minor planets in the Kuiper belt. Recently his artistic collaborations with Alex Miller of SpaceFiller have been featured in galleries and in a permanent installation in Seattle.

Simple Sequencer with Tone.js – On demand

Level: Beginner

Tone.js is a Web Audio framework for creating interactive music in the browser. The framework is built with language that is familiar to musicians, producers and programmers. In this workshop, you will use CodePen to learn the basics of Tone.js, how to make a sound, manipulate its characteristics and create a sequencer. You will also be introduced to basics of JavaScript!

Session Learning Outcomes

By the end of this session a successful student will be able to:

  • Feel confident using Tone.js

  • Use various synths from the framework and manipulate sounds

  • Build a sequencer using Tone.js and basic JavaScript

Session Study Topics

  • What web frameworks are and why we need Tone.js

  • Understand the concept of time in web

  • JavaScript Fundamentals

Requirements

  • A computer and internet connection

  • A webcam and mic

  • A Zoom account

  • A CodePen account (free)

About the workshop leader

Purvi Trivedi is a London based web developer with years of experience in music technology & ux research.

She currently works as a Frontend Engineer at Potato, an award-winning digital product studio that works with the likes of Google, PepsiCo, Mozilla, the BBC and NatWest.

She has co-produced KALA, an album that explores human emotions through the design of everyday sounds.

Interface design in Max with JS/JSUI

In this workshop we’ll look at scripting techniques for changing the appearance and behaviour of Max patchers, and the use of Javascript graphics to build new types of on-screen displays and controls.

Max contains an embedded Javascript engine which can be used to control aspects of Max from a textual language, providing more power and versatility than the default click-and-drag graphical interface which Max programmers are used to. The Javascript engine also has an embedded graphics system, allowing totally new and innovative interface elements to be created and embedded into the familiar Max world.
Topics:

– Max
– Javascript
– Patchers and scripting
– Graphics libraries

Requirements:
– Difficulty level: intermediate
– A good working knowledge of Max is expected
– Some familiarity with textual programming languages and graphics programming would be useful, but not required.

About the workshop leader:

Nick Rothwell is a composer, performer, software architect, coder and visual artist. He has built media performance systems for projects with Ballett Frankfurt and Vienna Volksoper, composed sound scores for Aydın Teker (Istanbul) and Shobana Jeyasingh Dance, live coded in Mexico and in Berlin with sitar player Shama Rahman, written software for Studio Wayne McGregor and the Pina Bausch Foundation, and developed algorithmic visuals for large-scale outdoor installations in Poland, Estonia, Cambridge Music Festival and Lumiere (London / Durham). He also teaches at Ravensbourne University London and writes for Sound On Sound magazine.