ceri-wilp/storytoolkitai

An editing tool that uses AI to transcribe, understand content and search for anything in your footage, integrated with ChatGPT and other AI models

StoryToolkitAI

Description

StoryToolkitAI is a film editing tool that tries to understand your footage and helps you edit more efficiently with the assistance of AI.

The tool works locally on your machine, independent of any other editing software, but it also integrates with DaVinci Resolve Studio 18.

Key Features

• Full video indexing and search (How-To)
• Free Automatic Transcriptions on your local machine
• Free Automatic Translation to English on your local machine
• OpenAI GPT integration - talk to AI about your content, or generate new ideas
• Search Content intuitively without having to type in exact words
• Story Editor - write screenplays containing your transcripts and export them for editing (EDL/XML/Fountain) (v. 0.20.1+)
• Translate transcripts to other languages using OpenAI GPT (v. 0.22.0+)
• Ask AI to create Stories and Selections based on your footage using OpenAI GPT (v. 0.22.0+)
• Automatic Speaker Detection in transcripts (v. 0.23.0+)
• Automatic Question detection in transcripts
• Transcript Groups - group transcript lines into whatever you need to find them easier
• Multi-format export of transcripts, including SRT, TXT, AVID DS and as Fusion Text node
• Import of existing SRT files
• Easy copy of timecoded transcript text to clipboard etc.

Resolve Studio Integrations

• Mark and Navigate Resolve Timelines via Transcript, plus other handy Resolve-only features
• Advanced Search of Resolve timeline markers using AI
• Copy Resolve timeline markers to transcript and vice-versa for advanced search
• Direct import of subtitles into Resolve bin

Planned Features

• Project File Management for more intuitive workflows and easier search
• Automatic Topic Classification to help you discover ideas in your transcripts
• Integration with other AI tools
• Integration with other software / standalone players
• Plus more flashy features as clickbait to unrealistically raise expectations and destroy competition

Some of the above features are only available in the non-standalone version of the tool, but they will be available in the standalone version in the next release.

For detailed features info, go here.

Download, Setup & Installation

To download the latest standalone release, see the releases page.

However, the standalone releases will most likely always be behind the git version, so, if you're comfortable with using the terminal / command line and want to always have access to the newest features, we recommend that you try to install the tool from source.

For detailed installation instructions go here.

Is it really free?

Yes, the tool runs locally and there's no need for any additional account to transcribe or search. These features will always be free as long as your machine supports them without external services.

The only feature that now requires external services is the Assistant feature which relies on OpenAI ChatGPT.

Some features are released earlier only to our Patreon Patrons. If you want to support the development, check out our Patreon page and get some cool perks.

---

About data privacy

By the way, if you feel that your content is sensitive or subject to privacy laws, no worries: the tool does not send anything that you don't want to the Internet, it only uses your local machine to transcribe and translate your audio.

Currently, the only features that send data from your machine to the Internet are:

• The StoryToolkitAI API Key check to storytoolkit.ai (only when entered in the Settings Window)
• The Assistant to OpenAI or storytoolkit.ai (only contexts and messages that you select and send).

The tool also checks for updates on every start.

---

Code

This tool is coded by Octavian Mot, your unfriendly filmmaker who hates to code and tries to keep it together as half of mots. Our team uses it daily in our editing room which allows us to update it with features that we need and think will be useful to others.

But, keep in mind that the tool is still being actively developed, raw and unpolished.

Feel free to get in touch with criticism, or weird ideas for new features.

The tool would be useless without using the following open source projects:

• OpenAI Whisper
• Sentence Transformers
• OpenAI ChatGPT
• pyannote.audio
• speechbrain
• spaCy
• CustomTkinter
• and many other packages listed in requirements.txt

---

Known issues and Troubleshooting

For troubleshooting and possible solutions to known issues, see the known issues section here or do a quick search in the Issues tab

Please report any problems directly in the Issues tab, here on Github: https://github.com/octimot/StoryToolkitAI/issues

---