Play an AI model as a musical instrument!
Just using an audio input


Play it Live!
Percussive augmentation
Beatboxing
Instrument retargeting


The BRAVE Plugin implements the BRAVE AI model for real-time use, with really low latency (~10 ms).

Get the Plugin & Pretrained Models


Plugin notarized by Apple - Latest update: 6/3/25 - Version 1.0

Note: This plugin is currently in beta testing, and there may be bugs or unexpected behavior. Your feedback is appreciated to help improve future versions. If you encounter any issues, please contact me.

Instructions

Use your preferred DAW (Digital Audio Workstation), that supports VST3 or AU plugin formats.
Each pretrained model implements a new sound you can control with your instrument.

  • Download the plugin to a directory where your DAW can see it.
  • Download and uncompress the pretrained models.
  • Open the plugin at your DAW, and select the folder where you stored the models.
  • Done! The models can now be selected from the GUI’s list.

Pretrained models

The provided models are trained from openly available datasets.

Model Dataset Description
birdsong.h5 British Birdsong Dataset, gathered from the Xeno Canto collection.
candombe.h5 Uruguayan candombe drumming dataset.
drumset.h5 The Expanded Groove MIDI Dataset. 2h 50m of a drummer performing on an electronic drum. kit.
filosax.h5 Trained using recordings of Participant 1 from the Filosax Dataset.

Check BRAVE’s Repo for instructions on how to train your own models. Contact Me if you would like to submit new models to the pretrained pack.

Contact

If you want to know more, stay up to date on this project, report a bug, or have any feedback, please contact me.

Contact Form

About

This project was developed as part of my PhD at the Centre For Digital Music and the Augmented Instruments Lab.