Giter Site home page Giter Site logo

dimitryzub / youtube-mention-tracker Goto Github PK

View Code? Open in Web Editor NEW
7.0 2.0 2.0 40 KB

Find target keyword mention(s) from YouTube videos. Similar to Mention but for videos. Sponsored by SerpApi.

Home Page: https://youtube-mentions-tracker.streamlit.app/

Python 100.00%
mention-detection python webscraping youtube youtube-downloader

youtube-mention-tracker's Introduction

YouTube Mention(s) Tracker

Streamlit YouTube Videos Mention Tracker Demo

Purpose/Idea

The main idea is taken from a great tool called Mention. This demo shows the same idea but for YouTube videos only by transcribing videos (even if the video without captions).

Scenario: user wants to track someone said certain keywords like "Serp Api". Or a query "switching from iphone to..." and target keyword like "poor" (for poor quality), or "No..." (no support for certain feature that android has) and similar keywords that may identify reasons of switching.

Another example is a certain search query in a company niche and a target keyword to look in those videos that may benefit company by getting more context out of it.

Things to improve
1. Async videos download or reading audio as a stream instead of saving?
2. Transcribing as a stream. Whisper can't do it at the time this demo is written. https://github.com/openai/whisper/discussions/2#discussioncomment-3702403
3. Run searches with cron job. Identify new videos for the same query(ies). 
4. Speed up pagination (if using) with multithreading (?). Commented out in the code to show how pagination done without multithreading. https://github.com/serpapi/google-search-results-python#batch-asynchronous-searches
5. Remove code duplication. Like creating centered button, SAVE_OPTION conditions (lines 258-311)

Video Example

youtube-videos-tracker.mp4

This is how transcribed results (if any) would look like:

transcribed-results

Usage

This section if you want to use your own API key. The demo on streamlit doesn't require you to use any API key.

Clone repository:

$ git clone https://github.com/dimitryzub/youtube-mention-tracker.git

Install dependencies:

$ cd youtube-mention-tracker && pip install -r requriements.txt

Add SerpApi api key for current shell and all processes started from current shell:

# used to parse youtube videos, has a plan of 100 free searches
$ export SERPAPI_API_KEY=<your-api-key>

Run the app:

$ cd youtube-tracker && streamlit run tracker.py

Sponsored by SerpApi ๐Ÿงก

youtube-mention-tracker's People

Contributors

dimitryzub avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.