Work Product for Audio to Haptic interaction design with Feelix supporting TorqueTuner

Name and Contact Information

  • name: Maxwell Gentili-Morin
  • website: LinkedIn
  • gitlab username: Maxw3llGM
  • timezone: GMT-4

Title

Audio to Haptic interaction design with Feelix supporting TorqueTuner ...

Short description of work done

The first and most extensive part of my Google Summer of code 2023 project was dedicated to adding support for the Haptic Knob called TorqueTuner in Feelix. Feelix export effects with a custom config file to the TorqueTuner. The TorqueTuner's hardware was also extended to now receive such files and playback the effect.

A development environment for Feelix on Apple Silicon Macs was also created.

Feelix also has the capability of creating and transmitting Midi Effects for the TorqueTuner to then playback into any usb enabled musical interface. This opens the avenue of developing haptic effects that can be used in conjunction of common musical instrument over midi and to continue the dev process of Feelix as a tool for haptic audio.

What code got merged

Added TorqueTuner and Midi to Feelix

  • Description
  • Extended Feelix to accept the TorqueTuner as a Motor type
  • Made transmission of data possible to the TorqueTuner from Feelix
  • Added Midi Effect type and capability of transmitting it out.
  • Fixed issue with exe-icon-extractor not being an optional node-module for Mac-Os
  • Fixed a MacOS specific problem where the menu bar did not change when switching between windows.
  • Major Commits
  • Midi transmission to TorqueTuner
  • Addition of TorqueTuner support in Feelix

Merging of Feelix Firmware with TorqueTuner

  • Description
  • Graphed on Feelix to the TorqueTuner's Firmware.
  • Added the reception and playback of simple Midi CC information, and torque based effects whilst preserving previous effects found on the TorqueTuner.
  • Midi information can be transmitted over Serial for Midi interfaces to and play.

What’s left to do

To continue the extension of Feelix with TorqueTuner, there is still some features that need to be added in the hardware side of the software. Better control of the uploaded effects on the TT are required to cover some edge cases for torque. The extension of effect types to the TT like velocity and potentially position. Also, a set of potential functions to modulate the effect array in creative ways. In true music producer fashion, there should be a way to apply modification to the uploaded effects in code.

Midi was a new addition to the Feelix project and to the TorqueTuner this summer. We began to add what we believed to be the most important parts of crafting midi effects in Feelix along with a very basic method of having them played on the TorqueTuner. First, a fix is required to have the midi effects sub values width be synced accordingly. More research is required to understand what would be welcome a addition on the hardware side for controlling and transmitting these midi effects.

Finally, on the line of communication protocols, the addition of say OSC over WIFI could be of interest.