emcf/thepipe

Feed PDFs, URLs, Slides, YouTube, GitHub, and more into Vision-Language models with one line of code ⚡

thepipe's Issues

Feature requests 🔨

Accepting requests features in this thread, please feel free to suggest!
The roadmap so far includes:

• Cloud storage extraction (Google Drive, OneDrive)
• E-Commerce platform extraction (Amazon, Ebay)
• Alternative version control platforms (GItLab, Atlassian)

Video frame + transcript extraction

Looking to support extraction of mp4, mov, webm, avi files as well as youtube for a Vision-Language model (not a video model)

Video files vary widely in duration, so due to the context window limitations of LLMs in 2024, this implementation would likely extract a constant number of images rather than extract a variable number of images at a constant frame rate.

Audio is not standard in commercial multimodal models today. Because of this, I am also looking to provide the option to transcribe audio from the video.

Make docker image

Apologies there is no docker image yet! 😅
I am on the case.

Audio transcript extraction

Looking to support mp3, wav

Audio is not standard in commercial multimodal models today in 2024. Because of this, I am also looking to transcribe audio to text, probably via Whisper.

No longer working after addition of THEPIPE_API_KEY

I have added the env var THEPIPE_API_KEY to my .env, .bashrc and at the commandline. It is not getting accepted.

{response['error']}")
ValueError: Valid environment variable THEPIPE_API_KEY not found. You may need to restart if you have set your API key. Visit https://thepi.pe/docs to learn more.