The memas from karnpapon

View Code? Open in Web Editor NEW

MeMaS, (/'mɛm-məs/) (MEta-Manifold Audiovisual System) is a set of tools for live-performance utilising computer vision with corpus-based concatinative synthesis

C++ 17.35% C 61.05% Python 15.50% SuperCollider 6.11%

memas's Introduction

MeMaS

MeMaS, (/'mɛm-mə/) (MEta-Manifold Audiovisual System), a set of tools for exploring a connection between image and sound, utilising computer vision with corpus-based concatinative synthesis

clone repo with submodule (`memas_sc`)

git clone --recurse-submodules https://github.com/karnpapon/MeMaS

folder structure

/memas_sc: a SuperCollider extension.
/python_cam_tracker: a Python tool for tracking target by OpenCV
/mapping_sounds: put any sound sources here
/mapping_sounds_data: a mapping_sounds's data exported after analysing with MeMaSEngine
/supercollider_setup: setup SC for live-performance (please install required libraries)
/esp32_setup: setup esp32-camera (the easiest way is using Arduino IDE)

prerequisites

some library can be installed easily with quarks

cruciallib, ( install via quarks ).
FluCoMa library for SuperCollider.
ddwMixerChannel audio mixer library.
mi-UGens a Mutable Instrument ported to SC.
ArturiaBeatStep, midi controller interface for Arturia BeatStep.

quickstart

cd python_cam_tracker && python3 main.py, to start ESP32-camera (default osc configs are --ip 127.0.0.1 and --port 57120)
- it'll send osc msg (x and y coord immediately (ranges are normalized to 0.0 - 1.0) )
- NOTE: currently osc's path is hardcoded as /test_plotter/1 (rework soon)
start memas_sc, by evaluating each blocks in memas_sc/sc_init.scd
- OPTIONAL: memas_sc/ndef.scd should run after memas_sc/sc_init.scd is done.
click OSC button in SuperCollider's window (MeMasEngine) to start receiving osc msg from ESP32
for step-sequencer please see anu