Max and Machine Learning with RunwayML – On-demand

Membership plan: Going Deeper | Topics: Creative Coding

Course overview

** 10/04/2024 Update: this course has not been updated following recent changes in RunwayML. We've made that course free as a result, and it will ultimately be retired.

RunwayML is a platform that offers AI tools to artists without any coding experience. Max/MSP is a visual programming environment used in media art that can be used to control RunwayML in a more efficient way.

What you'll learn

Understand the RunwayML workflow
Use Node4Max to control RunwayML and generate a video
Explore ML trendy models
Create a Dataset
Train a ML model
Process videos with the VIZZIE library

Who is this course for?

Course content

Max and Machine Learning with RunwayML - Session 1

Resources
1 - Intro AI
2 - Intro RunwayML
3 - Generate image from text (pt.1)

Max and Machine Learning with RunwayML - Session 2

1 Resources - generate image from text (pt.2)
1 - Generate Image from text (pt.2)
2 - Dataseta and Training
From text to Image with websockets - Part 1
From text to Image with websockets - Part 2
From text to Image with websockets - Part 3
From text to Image with websockets - Part 4
Part 5 - Dataset

Max and Machine Learning with RunwayML - Session 3

Useful links
Training
Images and videos generation
Part 1 - Training a dataset
Part 2 - GAN and latent space
Part 3 - Software architecture pt.1
Part 4 - Software architecture pt.2
Part 5 - Recap
Resources
Part 6 - ffmpeg fix

Max and Machine Learning with RunwayML - Session 4

Resources
Links to in-depth information
Part 1 - NodeScript pt 1 - Initialisations
Part 2 - NodeScript pt 2 - Noise Loop
Part 3 - NodeScript pt 3 - Generate images
Part 4 - NodeScript pt 4 - Write binary to disk
Part 5 - NodeScript pt 5 - Generate video
Part 6 - Post-process videos

Requirements

A computer and internet connection
Access to a copy of Max 8 (either trial or licence)
A code editor such as Visual Studio Code, Sublime or Atom
Attendees need to create a RunwayML account

Meet your instructor

Marco Accardi is a trained musician, multimedia artist, developer and teacher based in Berlin. He is the co-founder of Anecoica, a collective that organises events combining art, science and new technologies.