Who is this course for?
- • For students who want to learn visual sensor systems
- • Getting to grips by using visual sensor data creatively
- • Students who will be utilizing data streams
- • Learn data input
Course template / hosted architecture draft
An Introduction to Visual Sensors
Introduction to Kinect data processing in TouchDesigner for interactive visuals and installations.
Course overview
Attention: This workshop is Windows only.
TouchDesigner is a tool that gains popularity among musicians who want to create visuals for their music and do audio-visual experiments. In this workshop you will be guided through the integration of visual sensors into the TouchDesigner environment. We will work with Kinect in particular but the techniques will be applicable to other sensors as well.
Those without a Kinect sensor can follow the course by using provided recordings of sensor data. You will be able to play them back via Kinect Studio software, which will act as a sensor input for TouchDesigner. The main requirement for this course, however, is a Windows machine, as Kinect Studio is only supported on this platform.
Workshop will be led by Masha Rozhnova & Dániel Molnár
Function Store (Dániel Molnár) is a Berlin based artist and developer creating interactive installations and audio-visuals.
He has a software engineering background, focusing on TouchDesigner and related tools for the past two years and recently committing full-time to it.
He has interactive installations in various locations around Dubai in collaboration with Hybrid Xperience, is working with musicians to provide live visuals and digital content, and has a YouTube channel where he shares some of his secrets.
Requirements
- • A Windows 8 or 10 PC with Internet connection
- • Kinect SDK 2.0 installed
- • A three button mouse
- • TouchDesigner version 2021.15800 installed (non-commercial suffices)
- • A webcam and mic
- • A Zoom account
Course content
An Introduction to Visual Sensors
Lesson 1: Setup · Lesson 2: Tracking Joint Positions with Kinect CHOP · Lesson 3: Tracking Absolute Bone Rotations with Kinect CHOP
+
An Introduction to Visual Sensors
Lesson 1: Setup · Lesson 2: Tracking Joint Positions with Kinect CHOP · Lesson 3: Tracking Absolute Bone Rotations with Kinect CHOP
Session materials
Lesson 1: Setup
Open resourceLesson 2: Tracking Joint Positions with Kinect CHOP
Open resourceLesson 3: Tracking Absolute Bone Rotations with Kinect CHOP
Open resourceLesson 4: Using Depth Data from Kinect TOP
Open resourceLesson 5: Using Point Cloud Data from Kinect TOP
Open resourceQ&A 1: Using Blob Track TOP with Depth Data
Open resourceQ&A 2: Filtering out unknown Value Noise
Open resourceQ&A 3: Where to buy Kinect V2
Open resourceInstructors
Masha Rozhnova
Dancing Pixels (Masha Rozhnova) is a London based artist who creates audio-visual performances and videos for musicians. For the past three years she has been using TouchDesigner as the main tool for content creation, show control and as an engine to enable interaction with the audience. She performed at Live Performers Meeting in Rome, at New River studios and Crux events in London.