Creative Coding
Immersive AV Composition - On demand
Watch a preview
Part 1 - Project Setup
Course overview
Explore native VR development with the ImmersAV toolkit.
Learning outcomes
Discuss techniques for rendering material on VR headsets
Implement the Csound API within a C++ application
Create mixed raymarched and raster based graphics
Create an interactive visual scene using a single fragment shader
Generate the mandelbulb fractal
Generate procedural audio using Csound
Map controller position and rotation to audiovisual parameters using machine learning
Who is this course for?
- • These workshops will introduce you to the ImmersAV toolkit. The toolkit brings together Csound and OpenGL shaders to provide a native C++ environment where you can create abstract audiovisual art. You will learn how to generate material and map parameters using ImmersAV’s Studio() class. You will also learn how to render your work on a SteamVR compatible headset using OpenVR. Your fully immersive creations will then become interactive using integrated machine learning through the rapidLib library.
Requirements
- • A computer and internet connection
- • A web cam and mic
- • A Zoom account
- • Cloned copy of the ImmersAV toolkit plus dependencies
- • VR headset capable of connecting to SteamVR
Course content
What you will learn in this course
4 lessons
+
What you will learn in this course
4 lessons
- Course Overview
- Requirements
- Installation of ImmersAV
- Reading Material
Immersive AV Composition - LIVE Session 1
8 videos
+
Immersive AV Composition - LIVE Session 1
8 videos
Part 1 - Project Setup
Checking access...Part 2 - Audio - Environmental Noise
Checking access...Part 3 - Audio - Granular Patch
Checking access...Part 4 - Visuals - Infinite Plane
Checking access...Part 5 - Visuals - Colour the Scene
Checking access...Part 6 - Visuals - Mandelbulb
Checking access...Part 7 - Studio - Sound Source Placement
Checking access...Part 8 - VR Rendering
Checking access...
Immersive AV Composition - LIVE Session 2
6 videos
+
Immersive AV Composition - LIVE Session 2
6 videos
Part 1 - Setup
Checking access...Part 2 - Parameter Preperation
Checking access...Part 3 - Parameter Randomisation
Checking access...Part 4 - Neural network input
Checking access...Part 5 - Machine learning test
Checking access...Part 6 - Controller bindings
Checking access...
Instructors
Bryan Dunphy
Bryan Dunphy graduated in 2021 from a PhD at Goldsmiths University. He specialises in audio-visual, immersive performances and creations. Most of his work uses Machine Learning.