Soundstorm is a cutting-edge AI-powered audio manipulation application designed to provide a rich yet simplified experience for sound designers, algorithmic composers, and experimental audio enthusiasts. From sample pack creation and algorithmic composition to AI text-to-audio and onscreen ChatGPT, Soundstorm is a sonic powerhouse.
- 🎵 AI Text-to-Audio Generation: Generate any song or sound you want by a simple text prompt.
- 📦 Algorithmic Sample Pack Creation: Automatically generate sample packs based on user-defined criteria.
- 🎛 Audio Effects: Real-time audio effects like reverb, distortion, and more.
- 🎶 Algorithmic Composition: Create algorithmic composition.
- 🎹 MIDI Randomizer: Generate random MIDI sequences for creative inspiration.
- 🗨️ Chat with GPT: Integrated chat using OpenAI's GPT models for real-time conversational experiences.
- 🎲 GPT Randomizer: Generate random text snippets, prompts, or even song lyrics.
- Python 3.11
Clone the repository and navigate into the project directory. Run the following command to install all the necessary packages:
pip install pedalboard pydub replicate midiutil soundfile openai numpy pygameYou'll need to have API keys for both Replicate and OpenAI:
- For Replicate, sign up at: https://replicate.com and follow the instructions to get your API key.
- For OpenAI, sign up at: https://openai.com/product and follow the instructions to get your API key.
Add these keys in the appropriate sections within the application before running it.
After installing the prerequisites and obtaining the API keys, you can run the application using:
python Soundstorm.pyThis is SUPER rough. Currently, it only exists as a Python script and has only been tested on 2 different Macs. It is more or less a working prototype with a super stripped-down GUI. It can be buggy and does require finagling. Also things definitely need to be cleaned up, labeled better, etc etc. I could use assistance with this!
Contributions are welcome! This is the work of an amateur. Would love to see it fleshed out!
For support and feature requests, please open an issue on this repository.
This project is licensed under the MIT License.
Replace `soundstorm-logo.png` with the path to your logo if it is hosted elsewhere. If you're adding an absolute URL instead of a relative path within a repo, it would look something like ``. Remember to replace the URL with the actual URL where your logo image is hosted.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent