Immersive AV Composition -On demand / 2 Sessions

Level: Advanced

These workshops will introduce you to the ImmersAV toolkit. The toolkit brings together Csound and OpenGL shaders to provide a native C++ environment where you can create abstract audiovisual art. You will learn how to generate material and map parameters using ImmersAV’s Studio() class. You will also learn how to render your work on a SteamVR compatible headset using OpenVR. Your fully immersive creations will then become interactive using integrated machine learning through the rapidLib library.

Session Learning Outcomes

By the end of this session a successful student will be able to:

  • Setup and use the ImmersAV toolkit

  • Discuss techniques for rendering material on VR headsets

  • Implement the Csound API within a C++ application

  • Create mixed raymarched and raster based graphics

  • Create an interactive visual scene using a single fragment shader

  • Generate the mandelbulb fractal

  • Generate procedural audio using Csound

  • Map controller position and rotation to audiovisual parameters using machine learning

Session Study Topics

  • Native C++ development for VR

  • VR rendering techniques

  • Csound API integration

  • Real-time graphics rendering techniques

  • GLSL shaders

  • 3D fractals

  • Audio synthesis

  • Machine learning

Requirements

  • A computer and internet connection

  • A web cam and mic

  • A Zoom account

  • Cloned copy of the ImmersAV toolkit plus dependencies

  • VR headset capable of connecting to SteamVR

About the workshop leader 

Bryan Dunphy is an audiovisual composer, musician and researcher interested in generative approaches to creating audiovisual art in performance and immersive contexts. His work explores the interaction of abstract visual shapes, textures and synthesised sounds. He is interested in exploring strategies for creating, mapping and controlling audiovisual material in real time. He has recently completed his PhD in Arts and Computational Technology at Goldsmiths, University of London.

Video synthesis with Vsynth workshop

Level: Intermediate

In this series of 4 2-hours workshop, Kevin Kripper, the author of Vsynth, explains  how to interconnect the different 80 modules that come with Vsynth, exploring video techniques and practices that can create aesthetics associated with the history of the electronic image but also complex patterns founded in some basic functions of nature.

Here’s what you’ll learn in each workshop:

Lesson 1: video oscillators, mixers, colorizers.

Lesson 2: modulations (pm, fm, pwm, hue, among others).

Lesson 3: filters/convolutions and video feedback techniques.

Lesson 4: working with presets, scenes, audio and midi.

Vsynth is a high level package of modules for Max/Jitter that together make a modular video synthesizer. Its simplicity made it the perfect tool to introduce yourself to video synthesis and image processing. Since It can be connected to other parts of Max, other softwares and hardwares it can also become a really powerful and adaptable video tool for any kind of job.

Requirements

  • Basic knowledge of Max and Jitter
  • Have Max 8 installed
  • Familiarity with audio-synthesis or computer graphics would be useful.

About the workshop leader

Kevin Kripper (Buenos Aires, 1991) is a visual artist and indie software developer. He’s worked on several projects that link art, technology, education and toolmaking which has exhibited in festivals such as +CODE, Innovar, Wrong Biennale, MUTEK, among others. In 2016 he won first place at the Itaú Visual Arts Award with his work Deconstrucento. In addition, since 2012 he’s been dedicated to create digital tools that extend the creative possibilities of visual artists and musicians from all over the world. During 2017, he participated in the Toolmaker residency at Signal Culture (Owego, NY) and in 2018 received a mention in the Technology applied to Art category from the ArCiTec Award for the development of Vsynth.

https://www.instagram.com/vsynth74/

https://cycling74.com/articles/an-interview-with-kevin-kripper