500 error

[roontoon]

500 error

[roontoon]

Ran it again with the same results.... log file here http://pastebin.com/3br8LPvc

[rembo10]

Are you still having this issue? One thing I noticed is that it's skipping a lot of your artists since they have no US releases. I really hate how I'm handling it now so I want to get this fixed asap.

[roontoon]

Just got it working at startup so I am no logger viewing the activity directly from the terminal. I restarted the iTunes import yesterday and looked at the physical log and stopped with no indication of why. Then I launched the interface and it worked so I am not sure what is going on. I just now relaunched and restarted processing to see if it hangs again. Below is a link to the log. Processing stopped at about midnight last night. http://pastebin.com/twkFXMuW . In terms of how you are creating this why not just get the full list of artist without looking up each list of albums. When the user selects the artist then it will process. But even with this if the artist has a large number of albums then the processing takes a long time. I did this with the search feature and processing for someone like the rolling stones took many minutes....way too long for the average user to wait. Also is there a way to get a full list of artist from musicbranz with the full list of albums and just let the user browse through the list? Anyway.... let me know what you want and I will test...

d

[rembo10]

The problem is the way MusicBrainz handles releases/release groups. Think of each release group as an album, and releases as versions of the album (releases by country, live cd's, bonus disc editions, etc). It sucks because I need to do an extra query on every release to get detailed information (# of tracks, release country, etc) - I can't do by analyzing a release group query.

I think the best way would be to add the artist right away (best match if it's an itunes import or let the user select if it's a manual search) - then process the albums in the background, kind of like how sickbeard does it.

I suppose since I'm doing the query, I can build a list of all the albums to let the user browse the list (if the album they want isn't listed in Headphones for whatever reason, but exists in MusicBrainz). That's actually not a bad idea and wouldn't be too hard to implement.

[roontoon]

More data..... started the session at about 3:30 ran and then displayed the following....

Traceback (most recent call last):
File "/Applications/Headphones/cherrypy/_cprequest.py", line 645, in respond
response.body = self.handler()
File "/Applications/Headphones/cherrypy/lib/encoding.py", line 188, in call
self.body = self.oldhandler(_args, *_kwargs)
File "/Applications/Headphones/cherrypy/_cpdispatch.py", line 29, in call
return self.callable(_self.args, *_self.kwargs)
File "/Applications/Headphones/webServer.py", line 350, in importItunes
itunesimport.itunesImport(path)
File "/Applications/Headphones/itunesimport.py", line 59, in itunesImport
results = ws.Query().getReleaseById(releaseid, inc)
File "/Applications/Headphones/musicbrainz2/webservice.py", line 1037, in getReleaseById
result = self._getFromWebService('release', uuid, include)
File "/Applications/Headphones/musicbrainz2/webservice.py", line 1179, in _getFromWebService
stream = self.ws.get(entity, id, includeParams, filterParams)
File "/Applications/Headphones/musicbrainz2/webservice.py", line 288, in get
raise ConnectionError(str(e), e)
ConnectionError: <urlopen error [Errno 61] Connection refused>

Log entry.... http://pastebin.com/Cj8UGwQ3 BTW the log also includes an earlier attempt that just stopped.

[roontoon]

Ran import again and this time I used the folder structure instead of the xml and thinks behaved a little different so there might be a clue in the log. I started about 10:30 and things did stall in the early morning but what is interesting is that at about 4:00 it started to process again stopping again at about 6:00. Logs are here. http://pastebin.com/QhyicLQA

[roontoon]

Ran another run with folder structure instead of the xml. Gave 500 error again with a different problem. Error here http://pastebin.com/6LaCcJ6W

Logs here http://pastebin.com/jRiZs106

You might want to add to the logging so it would be easier to spot issues. How about logging key variables that correspond to the album. Also when it writes it to the database and any other critical location you deem necessary. I notice with just the current logs that is "appears" that you are checking with Musicbranz before the local DB. Is that the case? If so it might speed up things if you check with the local DB to see if it exist first.

d

[roontoon]

Thought of one other thing.... Have you looked at another music data source such as last.fm? Here is a link to their API.

http://www.last.fm/api/intro

[rembo10]

I've been trying to reproduce the connection error with the artists that it seems to be stopping on but it goes through ok for me. I need to put in more specific logging for sure. Still looking into this though.

It checks MB first to get an artist ID. It uses that unique key rather than, say, the artist name because you may have two bands with the same name, or there may be a misspelling, etc.

I just started looking at last.fm. It looks like an awesome API - and they use MusicBrainz id's as well, so would be easy to implement. I can all kinds of features like upcoming concerts, etc. Will be quite cool

[roontoon]

Another API https://github.com/discogs/discogs-python-client

for http://www.discogs.com/help/api

Music APIs http://www.programmableweb.com/apis/directory/1?apicat=Music

Just found this and could be useful

[rembo10]

Thanks!

On Jul 7, 2011, at 4:24 PM, roontoon wrote:

Another API https://github.com/discogs/discogs-python-client

for http://www.discogs.com/help/api

Music APIs http://www.programmableweb.com/apis/directory/1?apicat=Music

Just found this and could be useful

Reply to this email directly or view it on GitHub:
#27 (comment)

[rembo10]

Are you still getting this error?

[roontoon]

Just tried it with the new build and it hangs with out error messages. Could you not test on your machine with my xml file. Could it be that some of my library is screwed up? LMK if you want the xml file.

[rembo10]

Is it an itunes xml? Did you try the music scanner?

You can send the xml to [email protected] and I'll take a look.

On Jul 12, 2011, at 6:00 PM, [email protected] wrote:

Just tried it with the new build and it hangs with out error messages. Could you not test on your machine with my xml file. Could it be that some of my library is screwed up? LMK if you want the xml file.

Reply to this email directly or view it on GitHub:
#27 (comment)

[rembo10]

I'm going to close this issue for now since there have been a lot of changes in the last day. If you still get this error open up a new ticket