Device Details

Device Overview

Name/Version: binaural-spat 1.0
Author: kasperskov  
Description: binaural_spat is a collection of Max for Live devices for binaural spatialisation in Ableton Live using IRCAM's Spat5 Library. binaural_spat makes use of new multichannel routing capabilities in Live 10 and Max for Live. Before continuing, make sure to have both installed.

The current version is still being tested, so if you encounter any issues on Windows or Mac, please report back to me.

Installation

When you clone the repository, make sure to leave the Max for Live devices in the downloaded folder. This ensures that other included files (i.e. 3D head model) gets loaded correctly when setting up a Live Set.

First steps

1. Add binaural_spat listener

Create a new audio track in Ableton and add the 'binaural_spat listener'-device. The track will automatically get renamed 'listener'. This track will act as the receiver of audio from up to 16 'binaural_spat source'-devices. Here you can also monitor the input from the source devices.

By default the listener device loads a built-in KEMAR-HRTF. Clicking 'sofa loader' will bring up the included Sofa Loader interface from the Spat5 Library. Here you can choose and download HRTF-files from existing databases in order to get a better result.

2. Add binaural_spat sources

Create a new audio or midi track and add the 'binaural_spat source'-device. When loading a source-device you are asked to give the device a number (between 1-16). Make sure not to load two source devices on one track, and always give numbers in the correct order.

The source device takes a stereo input and converts it to mono. The mono signal is automatically routed to the corresponding input in the listener-device.

Note that adding a source-device to a track will automatically set the track to "Sends only". This is done because the audio gets routed internally to the listener-device.

You can add up to 16 source devices (although 16 is not recommended due to high CPU load).

Head-tracking capabilities

The listener-device is ready for setting up a head-tracking system. As an experimental feature, I have included the device 'gyrosc2live' which enables OSC (Open Sound Control) communication between the iOS app GyrOSC and the listener-device. The gyrosc2live-device receives gyroscope data from the app (preferably installed on an iPhone) and makes it easy to map euler angles (pitch, yaw, roll) to the 'pitch', 'yaw', and 'roll' parameters in the listener device. When the app and device is set up, place the iPhone on top of your head and click 'reorient'. By moving your head around you should be able to see/hear the result accordingly.

In order to setup more complex head-tracking systems with position and head-orientation, you can create a similar Max for Live device and map the data to position (x, y, z coordinates) and euler-angles inside the listener-device.
 

Device Details

Tags effect, utility
Live Version Used: 10.1.9
Max Version Used: 8.1.3
Date Added: Apr 11 2020 12:17:51
Date Last Updated: Not updated yet
Device Type: audio_device
Download URL (report link) https://github.com/kasperskov/binaural_spat-v1.0?fbclid=IwAR0w8JvGy5d5x8mvBIV_Bc5udFkSeETcNHaG4-czzW
License (more info): None


Comments

Very cool! Thanks for sharing.

Nice work, thanks for sharing. The listener won't output: I get 'Error 126 loading external spat5.spat~'. I'm a Windows 10 user. Do I need spat5 installed at all? I try putting the spat folder in the Live folder. Thanks

Hi barouet,

Some Windows users are experiencing issues loading the spat-externals. Try installing the spat5 library by following this link: https://forum.ircam.fr/projects/detail/spat/

You need to install the package and put it within your Max.app search path.

I?ll post a fix whenever I figure this out.

Thanks.

All the best,
Kasper

Login to comment on this device.

[ browse device library ]