anyaudio/anyaudio-server

:musical_note: Simple server to search youtube and give direct audio download and stream links

anyaudio-server's Issues

Complete slide on little scroll

The orange view on /beta page should slide down completely even on a little scrolling, as is the case while clicking Explore button.

Add API endpoint to fetch the list of supported playlist

Add support for album art

Search not working

Upon inspection, I found out that setting INF in search.get_videos was the issue.

        pos = html.find('yt-lockup-tile')
        if pos == -1:
            pos = INF
        vid.append(html[:pos + 2])

So string operation html[:pos+2] didn't work (as INF is not an integer).

Set proper filename in Content-Disposition on download

#17 (comment)

After a way to get video info from its ID has been implemented and used in /download endpoint, we should also give the file a proper name so that it downloads into user's system with a filename more helpful than music.mp3.

Add AUTHORS

A simple text file to keep track of all those who contributed to the code.

Incorrect song length while streaming

As of now, the song length that shows on browser is 00:00:10, but vlc can tell its actual length.

Add streaming option

Create API endpoint to search for results on youtube

It should return the following values.

1. Video title
2. Length
3. Uploader
4. Description

Length of audio shown fixed at 10 seconds when streaming

When using HTML5 audio element for audio playback, the shown length is always 10 seconds. This doesn't affect the playback though and the audio always plays completely.

Add favico

Allow FFMPEG_PATH to be set

This will allow users to test full features of app locally.

Test trending worker

It will also help us make sure that playlist links are correct.

Show Loading... text when search result is loading

Add a platform for general discussion

Maybe Gitter.

Encrypt get download link (/g/) API

API to get download url of a video ( /g/ ) can be encrypted to prevent public use. On /search, encrypted download links can be returned in the response. So the android and web app will have no problems whatsover. On the other hand, we will be able to reduce ill-use of our API and server.
And this will automatically fix #17 .

I see only up-sides of this change. So I think I will do it.

@bxute Android app will need update after this.

Incorrect thumbnail in trending Songs

Create API to return trending songs

Url is https://www.youtube.com/channel/UC-9-kyTW8ZkZNDHQJ6FgpwQ?gl=US

Official "numb" song won't download

The first result when searching "numb" with title Numb (Official Video) - Linkin Park and ID kXYiU_JCYtU doesn't download when clicking on the link. It opens up a blank page.

Research/Fix this issue, then close.

Make the website public

Make the website along with the API public.
If there are issues later, we can make it back to private.

@bxute What do you think ?

Related #2

Downloads are 404 with option --no-cache-dir

anyaudio/anyaudio-android-app#3

I researched on this issue and found that setting --no-cache-dir option is the reason that some links created are 404. Removing it will fix it.

If a client disconnects from download, then server crashes

A try block over the return response should fix it.

http://stackoverflow.com/questions/20568216/python-handling-socket-error-errno-104-connection-reset-by-peer

Implement a log viewer on the website

Let's make the url /logs show the most recent request logs. To prevent unauthorized access, we can protect it using environment variable SECRET_KEY which is being already used in encryption.

Make all page load requests use networking.py

Proper error handling and reporting

Currently any server error returns an 500 with message Some error occurred. Proper error handling and reporting needs to take place. Different child classes of Exception can be kept in core/utils.py which will be used to track different problems as they occur.

def something():
    ...
    try:
        try:
            do_complex_operation_1()
        except MyException1:
            raise MyException2()
        ...
        try:
            do_complex_operation_2()
        except MyException3:
            raise MyException4()
        ...
    except MyException2:
        user_message = 'Error in operation 1'
        ...
    except MyException4:
        user_message = 'Error in operation 2'
        ...
    ...
    return_dictionary{'userMessage'} = user_message

This can be used at different levels to precisely track the error.

Convert /api/v1/d/<url> to /api/v1/d?url=...

Currently, the calls are made in the format /api/v1/d/sfsagaehbadfwdVAEDGFVAdFA..., which is too lengthy to log as base path and also doesn't follows API standards.

Better way can be /api/v1/d?url=sfsagaehbadfwdVAEDGFVAdFA....

@aviaryan : Any comments?

Standardize API

Currently, the API calls are like /g/<video id> and /search?q=<query>.

Make it more standard like

• /api/v1/g/<video id> (or /api/v1/g/<video id>.json, /api/v1/g/<video id>.xml, etc. )
• /api/v1/search?q=<query> (possibly with more parameters like offset and limit)

The response needs to be standardized too.

Have a look at White House API Standards.

Use YoutubeDL python wrapper to extract download info

Right now we are using youtube-dl command-line call to get the download url. A more flexible option is to use the Python wrapper. This will allow to get other additional information about the download which is otherwise un-accessible from a single command-line call.

http://stackoverflow.com/questions/32118510/how-to-extract-file-size-from-youtube-dl-in-python-script

Lazy loading of trending playlists and playlist items

Limit by duration as conversion takes time

The amount of time taken to convert OR the amount of time taken to start download is directly proportional to length. This can keep a worker busy for far more longer time than expected.

Start searching when Enter is pressed in search box

Create a frontend for users to search and download

Fix Docker, add Postgres container and volume

Since now postgres database has been added in the application, the Docker deployment is now non-functional.

Log API requests

• IP
• Time
• API info

Redesign website

Redesign website with a modern and rich interface.
The new design will be kept in beta for a few days under ymp3.aavi.me/beta/.
Be sure to handle the application edge cases correctly in JavaScript. (see main.js)

@ansarimofid

Searching "numb" gives an invalid result

Search "numb"

One of the results is Mix - Numb (Official Video) - Linkin Park with ID as
kXYiU_JCYtU&list=RDkXYiU_JCYtU. Either fix the parser for these types of videos or remove them from the results.

Convert music to mp3 on server

Download the audio file and convert it to mp3 on the server itself.

Add about us text

Please add about us text in overlay menu section.

Write tests

• Number of results when searching "Numb" . Is 19 now.
• Download of an audio
• 400 in case of bad download link of audio

Loosen restriction on allowable video length

Since we have moved on from m4a to mp3, serving large songs won't be an issue.

IMO, we can set the limit for m4a songs to 1 hour and leave the mp3 limit as it is.

Return video description with data while retrieving trending or search results

Offset in trending API

In /api/v1/trending, no offset parameter is given. Which will be expensive when some AJAX requests for more results.

Implement autocomplete of results

See http://shreyaschand.com/blog/2013/01/03/google-autocomplete-api/

Dockerize the application

A docker-able application will be easy to setup and run on different platforms. And not to mention, all the cool kids are doing it. So why stand back ? 😉

Run ffmpeg in quiet mode

Running ffmpeg in quite mode will make it faster and save extra output whie running.

ffmpeg -loglevel quiet [...]

Encrypt /d/ download urls

#17 (comment)

The real need is to block users to send any link they want into the /d/ endpoint. And we can do it using little encryption. So I think this issue can be closed. I will open a new issue for encrypting /download urls.

We can use a simple PRIVATE_KEY on the server to encrypt the urls and then further decrypt them back.

Add a Makefile

While writing tests, I realized that running tests locally will require a series of steps.
So we should define a Makefile to streamline the process.
It can also have targets for run and install.

Handle non success error codes

The current beta website does nothing in case of error.

Exception occurs mentioning incorrect padding for many requests.

Error like this are very frequent. They must be removed as soon as possible.

Traceback (most recent call last):
  File "xxxxxx/youtube-mp3-server/ymp3/views.py", line 93, in get_link
    data = decode_data(get_key(), url)
  File "xxxxxx/youtube-mp3-server/ymp3/helpers/encryption.py", line 40, in decode_data
    dec = decode(key, data)
  File "xxxxxx/youtube-mp3-server/ymp3/helpers/encryption.py", line 16, in decode
    enc = base64.b64decode(enc)
  File "/usr/lib/python2.7/base64.py", line 78, in b64decode
    raise TypeError(msg)
TypeError: Incorrect padding

Setup ffmpeg auto-install at server