Audio Reactive Shaders with Shader Park + TouchDesigner – On-demand
Level: Intermediate: Some previous experience with javascript, or programming is recommended. No experience with TouchDesigner is needed.
Overview
Explore 3D shader programming through a Javascript interface without the complexity of GLSL. Shader Park is an open source project for creating real-time graphics and procedural animations. Follow along through multiple examples using a P5.js style live code editor. Expand upon the examples and bring them into TouchDesigner to create your own audio reactive music visualizers. Explore the Shader Park community gallery where you can fork other people’s creations or feature your own.
Who is the workshop for?
Artists interested in exploring real-time procedural 3D graphics and animations applied as music visualizations.
Developers with experience programming in javascript, a p5.js style library, or similar language is recommended. Bonus if you know shader programming.
By the end of this session a successful student will be able to:
-
Create raymarched 3D shaders with Shader Park
-
Intro to TouchDesigner + Shader Park plugin
-
Overview of audio analysis
-
Create your own audio reactive music visualizer
Session Study Topics:
-
TouchDesigner
-
Shader Park
-
Shaders
-
Raymarching
-
Audio analysis
Requirements
-
A computer and internet connection
-
A copy of TouchDesigner
-
A downloaded song(.mp3 .aif .aiff .wav) you’d like to turn into a music visualizer.
About the workshop leader
Torin Blankensmith and Peter Whidden formed a creative-coding organization while at college together. They hosted weekly workshops for students from various disciplines on emerging topics in computer graphics. It was in this group that the first prototype of Shader Park was developed.
Torin is a freelance creative technologist and adjunct professor at the Parsons School of Design in New York City teaching TouchDesigner and Creative Coding. Based out of NEW INC, Torin creates immersive installations, experiences, interfaces, and websites. Torin’s work explores emerging techniques in real-time graphics pulling inspiration from systems and patterns of emergent behavior in nature. This work has translated into creating large scale environments for medical professionals to alleviate stress/burnout, for patients in clinical studies aiding in neuroscience research on brain recovery, and for commercial spaces bringing sanctuary to the urban landscape.
Peter is a creative software engineer whose work spans physics, astronomy, machine learning, and computer graphics. He currently works at the NY Times R&D lab focused on emerging computer vision and graphics techniques. Previously, Pete has worked with CERN to build interactive 3D visualizations used in particle physics. He’s also developed software with the Data Intensive Research in Astrophysics and Cosmology (DIRAC) Institute which enabled the discovery of over 30 new minor planets in the Kuiper belt. Recently his artistic collaborations with Alex Miller of SpaceFiller have been featured in galleries and in a permanent installation in Seattle.
Simple Sequencer with Tone.js – On demand
Level: Beginner
Tone.js is a Web Audio framework for creating interactive music in the browser. The framework is built with language that is familiar to musicians, producers and programmers. In this workshop, you will use CodePen to learn the basics of Tone.js, how to make a sound, manipulate its characteristics and create a sequencer. You will also be introduced to basics of JavaScript!
Session Learning Outcomes
By the end of this session a successful student will be able to:
-
Feel confident using Tone.js
-
Use various synths from the framework and manipulate sounds
-
Build a sequencer using Tone.js and basic JavaScript
Session Study Topics
-
What web frameworks are and why we need Tone.js
-
Understand the concept of time in web
-
JavaScript Fundamentals
Requirements
-
A computer and internet connection
-
A webcam and mic
-
A Zoom account
-
A CodePen account (free)
About the workshop leader
Purvi Trivedi is a London based web developer with years of experience in music technology & ux research.
She currently works as a Frontend Engineer at Potato, an award-winning digital product studio that works with the likes of Google, PepsiCo, Mozilla, the BBC and NatWest.
She has co-produced KALA, an album that explores human emotions through the design of everyday sounds.
Interface design in Max with JS/JSUI
– Max
– Javascript
– Patchers and scripting
– Graphics libraries
About the workshop leader:
Nick Rothwell is a composer, performer, software architect, coder and visual artist. He has built media performance systems for projects with Ballett Frankfurt and Vienna Volksoper, composed sound scores for Aydın Teker (Istanbul) and Shobana Jeyasingh Dance, live coded in Mexico and in Berlin with sitar player Shama Rahman, written software for Studio Wayne McGregor and the Pina Bausch Foundation, and developed algorithmic visuals for large-scale outdoor installations in Poland, Estonia, Cambridge Music Festival and Lumiere (London / Durham). He also teaches at Ravensbourne University London and writes for Sound On Sound magazine.