Using openFrameworks, ofxRapidLib and ofxMaximilian, participants will learn how to integrate machine learning into generative applications. You will learn about the interactive machine learning workflow and how to implement classification, regression and gestural recognition algorithms.

What you'll learn

• Session 1: Set up an openFrameworks project for classification, Collect and label data, Use the data to control audio output and Observe output and evaluate model
• Session 2: Set up an openFrameworks project for regression, Collect data and train a neural network, Use the neural network output to control audio parameters and Adjust inputs to refine the output behaviour
• Session 3: Set up an openFrameworks project for series classification, Design gestures as control data, Use classification of gestures to control audio output and Refine gestural input to attain desired output
• Session 4: Explore methods for increasing complexity, Integrate visuals for multimodal output, Build mapping layers and Use models in parallel and series

Requirements

• A computer and internet connection
• Installed versions of the following software: openFrameworks, ofxRapidLib and ofxMaxim
• Preferred IDE (eg. XCode / Visual Studio)

Course content

Who is this course for

• You will explore a static classification approach that employs the k-Nearest Neighbour (KNN) algorithm to categorise data into discrete classes. This will be followed by an exploration of static regression problems that will use multilayer perceptron neural networks to perform feed-forward, non-linear regression on a continuous data source. You will also explore an approach to temporal classification using dynamic time warping which allows you to analyse and process gestural input.

Useful links

About the workshop leader

Bryan Dunphy graduated in 2021 from a PhD at Goldsmiths University. He specialises in audio-visual, immersive performances and creations. Most of his work uses Machine Learning.