mr-highball/yt-indexer

a simple & configurable tool to index youtube videos

yt-indexer's Issues

Useful queries

Would be good for others to store some useful queries that can just work for certain common uses

ac's

• new folder in repo to hold queries
• distinct channels for keyword
• full video url for search term
• breakdown of counts per search term

add channel csv to config

we need to allow for setting a channel listing to be used instead of the keyword searching. often users know exactly who they want to watch, so let them specify

ac's

• new config option for channel csv (id list)
• when channel list is used videos will only be indexed from those channels
  • keywords will be ignored in this case

provide a bundled web server that produces a landing search page for content

indexing videos is cool, but not too many people prefer to use sqlite as their main means to procure video content.

ac's

• new config option for enabling the browser and any supporting properties
  • listening port
• when enabled the browser will create a web server and listen for incoming requests
  • an html page with basic search / filtering options should be provided back to the user

Use log error method

Forgot to use the LogError method in some places which reports to the error table. Need to cleanup those places and any other spots that could use exception capturing.

syntax error near "xyz" on insert resource

have received a small amount of errors while indexing that seem to be related to the title of videos which prevents the insert of the record

ac's

• troubleshoot what causes syntax errors in the generated SQL
  • ❓ is this due to unicode chars?
• implement fix for all areas that could be affected (title, keywords, description etc...)

Link origin keyword for search result

Would be good to link the keyword that was originally used to retrieve a search result

ac's

• new table holding the following fields
  • id (pkey)
  • resource_id (fkey to resource.id)
  • keyword (origin keyword)

[Suggestion] Needs an appsettings.json.example file

Hey mr-highball(@mr-highball),

Could you please drop a appsettings.json.example file somewhere in the repository?
Many thanks in advance 😄 !!

This way we can just edit that one instead of trying to guess what the format is 😛 .

I guess you get a pass on this one since your alcohol level kinda impaired your judgement 😜

Cheers,
Gus

---

P.S.: I like being first poster, LOL!!

make use of quota vars

quota variables (remaining, spent) were stubbed out, but never fully implemented (other than persistence from json)

ac's

• when a search request is performed, decrement by the quota cost
• reset the spent amount back to the daily quota when the next set of search requests are queued

wrong snippet association

snippet seems to sometimes getting associated with the wrong resource_id which gives a misleading title / description / thumbnails. need to track this down and fix

video metadata

would be good to capture additional video metadata so that we can better query on video quality

metrics

• likes / dislikes (aka updoots)
• views
• video duration