egorlakomkin/ktspeechcrawler

Automatically constructing corpus for automatic speech recognition from YouTube videos

ktspeechcrawler's Issues

why GOOGLE_TEST default OK? Why didn't added GoogleRandomSubsetWERFilter class in process.py?

why GOOGLE_TEST default OK?

Why didn't added GoogleRandomSubsetWERFilter class in process.py pipeline?

first up all thanks for Given this Project as Open-Source. Awesome work. thank you so much KTSpeechCrawler team.:)

i was tried KTSpeechCrawler project to collecting youtube audio datasets for ASR Speech-to-text task.

i was collected and finished entire steps. after that i was tested transcipt with corresponding audio files (.wav, .txt).

here i getting 11/100 audios are mistakes.

if we will apply google_speech_test , and validate to remove less than the threshold means (threshold=0.85) we can get good proper audiofiles and transcipt.

can you please tell where i need to start and add this module to do google_speech_test?

Here any complexity will come, for using google_speech_test?

that pipeline module,

pipeline = Pipeline([
    OverlappingSubtitlesRemover(),
    SubtitleCaptionTextFilter(),
    CaptionNormalizer(),
    CaptionRegexMatcher(good_chars_regexp),
    CaptionLengthFilter(min_length=5),
    CaptionLeaveOnlyAlphaNumCharacters(),
    SubtitleMerger(max_len_merged_sec=10),
    CaptionDurationFilter(min_length=1, max_length=20.0)
])

here which place i need add that module? last is enough?

Thank you sir :)

Failed to download

Tried to run the script both on local machine and google colab, but failed. Please see the error message as below.

Question: Where exactly is Gentle being used

First of all great work. Kudos!
In your paper you have written than Gentle is being used for forced alignment in the post processing stage. But in the code, I wasn't able to find out where it was being used. Can you please help?

0 videos downloaded

I tried running this to collect sample data. But for every keyword i am getting same issue.

[youtube:search_url] in: Downloading webpage
[download] Downloading playlist: in
[youtube:search_url] playlist in: Downloading 0 videos
[download] Finished downloading playlist: in
[youtube:search_url] is: Downloading webpage
[download] Downloading playlist: is
[youtube:search_url] playlist is: Downloading 0 videos

whats wrong I might have done ?