Ascii error when scanning current music

[bpierce815]

Ascii error when scanning current music

Same here 14-Jul-2011 19:48:42 - ERROR :: CP Server Thread-5 : Unable to complete the scan: 'ascii' codec can't decode byte 0xc3 in position 31: ordinal not in range(128). No idea what the problem exactly is.

[rembo10]

Yeah the logging is pretty vague.

I'm going to fix the unicode errors today

On Jul 14, 2011, at 8:08 AM, [email protected] wrote:

When scanning my current library, I get the following error in the logs:

14-Jul-2011 10:01:50 - ERROR :: CP Server Thread-8 : Unable to complete the scan: 'ascii' codec can't decode byte 0xf1 in position 7: ordinal not in range(128)

I would be happy to rename the offending file/folder. However, there is no information on what that file/folder may be.

Suggestion: Add more verbose information in the logs to detect what files/folders are currently being scanned and/or fix the ascii issue that is being detected.

Thanks for your work,
Ben

Reply to this email directly or view it on GitHub:
#42

[rembo10]

I'm trying to reproduce this on my end so I can fix it but it reads my library everytime. I've thrown in every latin character I could but still nothing.

I'll have to update the logging for the import to see where it's failing.

In your logs, before the failure, do you see a message showing how many music files it has? That might help me pinpoint where it's failing

On Jul 14, 2011, at 8:08 AM, bpierce815 wrote:

When scanning my current library, I get the following error in the logs:

14-Jul-2011 10:01:50 - ERROR :: CP Server Thread-8 : Unable to complete the scan: 'ascii' codec can't decode byte 0xf1 in position 7: ordinal not in range(128)

I would be happy to rename the offending file/folder. However, there is no information on what that file/folder may be.

Suggestion: Add more verbose information in the logs to detect what files/folders are currently being scanned and/or fix the ascii issue that is being detected.

Thanks for your work,
Ben

Reply to this email directly or view it on GitHub:
#42

15-Jul-2011 09:20:21 - INFO    :: Thread-12 : Restarting Headphones with ['/opt/bin/python', '/opt/share/headphones/Headphones.py', '-d', '--nolaunch']
15-Jul-2011 09:20:24 - INFO    :: MainThread : Checking to see if the database has all tables....
15-Jul-2011 09:20:24 - DEBUG   :: MainThread : Trying to execute: ""/opt/bin/git" rev-parse HEAD" with shell in /opt/share/headphones
15-Jul-2011 09:20:24 - DEBUG   :: MainThread : Git output: fa96194749e4deadc27a1e96bc26f0fb96846d88
15-Jul-2011 09:20:24 - DEBUG   :: MainThread : Forking once...
15-Jul-2011 09:20:24 - DEBUG   :: MainThread : Forking twice...
15-Jul-2011 09:20:24 - INFO    :: MainThread : Daemonized to PID: 10472
15-Jul-2011 09:20:24 - INFO    :: MainThread : Starting Headphones on port: [port]
15-Jul-2011 09:20:25 - INFO    :: MainThread : Headphones is already up-to-date.

Now I click "Submit Query" on the Manage screen.

15-Jul-2011 09:20:48 - ERROR   :: CP Server Thread-7 : Unable to complete the scan: 'ascii' codec can't decode byte 0xc3 in position 31: ordinal not in range(128)

That's all the logging I got there.

[rembo10]

Is that the full log between when you pressed it and getting the error? Trying to pinpoint where this is happening

On Jul 15, 2011, at 12:21 AM, nightspirit81 wrote:

15-Jul-2011 09:20:21 - INFO :: Thread-12 : Restarting Headphones with ['/opt/bin/python', '/opt/share/headphones/Headphones.py', '-d', '--nolaunch']
15-Jul-2011 09:20:24 - INFO :: MainThread : Checking to see if the database has all tables....
15-Jul-2011 09:20:24 - DEBUG :: MainThread : Trying to execute: ""/opt/bin/git" rev-parse HEAD" with shell in /opt/share/headphones
15-Jul-2011 09:20:24 - DEBUG :: MainThread : Git output: fa96194
15-Jul-2011 09:20:24 - DEBUG :: MainThread : Forking once...
15-Jul-2011 09:20:24 - DEBUG :: MainThread : Forking twice...
15-Jul-2011 09:20:24 - INFO :: MainThread : Daemonized to PID: 10472
15-Jul-2011 09:20:24 - INFO :: MainThread : Starting Headphones on port: 49194
15-Jul-2011 09:20:25 - INFO :: MainThread : Headphones is already up-to-date.

Now I click "Submit Query" on the Manage screen.

15-Jul-2011 09:20:48 - ERROR :: CP Server Thread-7 : Unable to complete the scan: 'ascii' codec can't decode byte 0xc3 in position 31: ordinal not in range(128)

Reply to this email directly or view it on GitHub:
#42 (comment)

Yup, uncut version (except [port]) ;)

[rembo10]

can you guys try something for me? either open up IDLE or whatever your python interpreter is, or make a new text file called test.py and put in the following code:

import os
for r,d,f in os.walk(%path to your music dir with a single quote - like: '/Users/music'%):
for files in f:
if any(files.endswith(x) for x in (".mp3", ".flac", ".aac", ".ogg", ".ape")):
results.append(os.path.join(r,files))

And then post the traceback here? If you need more help doing this let me know

[rembo10]

sorry the code should look like this: http://pastebin.com/yyZMPfGf

[bpierce815]

I ran the code and it said that return was outside the function. Here is my script:

import os

results = []

for r,d,f in os.walk('/mythtv/music'):
for files in f:
if any(files.endswith(x) for x in (".mp3", ".flac", ".aac", ".ogg", ".ape")):
results.append(os.path.join(r,files))
return results

Also note, this is happening when I am doing a music directory scan, not an Itunes Import.

[bpierce815]

Just tried adding the directory into the legacy itunes import section and it seems to be going through my library now. So the issue must be with the Scan Music Library section of the Manage page.

[bpierce815]

note: I do not have an itunes XML file, so it appears that the Itunes import section is doing exactly what I wanted the directory import section to do.

nightspirit81 - have you tried adding the directory path via the Itunes import section? Does it work for you?

[rembo10]

Have you updated to the latest version? Still not working?

[bpierce815]

Yes I have updated to the latest Version. Issue still persists when trying to use the "Scan Music Library" section. However when using the "Import or Sync Your iTunes Library/Music Folder" section, headphones scans fine till about 2/3s of the way through my library then stops. But I think that may be a different issue and will file a different bug on it so this one can stay focused on the ascii issue.

[fade23]

Latest version gets further than it did before, but eventually throws the same error. Scan Music Library still dies immediately. It looks like it's now dying at the Album import step, so subsequent runs will get further on until the next time it hits an artist with a problem album.

[david81]

I gave the iTune import a try and it certainly performed a scan, but the results were a bit....odd. It didn't really pick up any artists and the entries it did add just didn't make much sense.

Screenshot

[rembo10]

@ David81 - I have a fix for the artists you highlighted, I should be getting it up tonight. As for the other results, it looks like it's adding in the genres as artists. What kind of files was it scanning? Seems like its an issue with beets

On Jul 15, 2011, at 5:19 PM, david81 wrote:

I gave the iTune import a try and it certainly performed a scan, but the results were a bit....odd. It didn't really pick up any artists and the entries it did add just didn't make much sense.

Screenshot

Reply to this email directly or view it on GitHub:
#42 (comment)

[david81]

The files are organized like this "/mnt/user/Music/Genre/Artist/Album". All are properly tagged and organized (in English). Those artists that are highlighted don't exist in my collection.

[rembo10]

Ohh - then the itunes import won't work (unless you give it an xml file). It just scans the top level directory (so in your case, it's trying to add all the genres as artists). The only way to use it is if you pointed it at each Genre folder and imported it that way.

Have you tried the Music Scanner?

On Jul 15, 2011, at 5:44 PM, david81 wrote:

The files are organized like this "/mnt/user/Music/Genre/Artist/Album". All are properly tagged and organized (in English).

Reply to this email directly or view it on GitHub:
#42 (comment)

[david81]

The normal music library import gives:

"15-Jul-2011 20:52:19 - ERROR :: CP Server Thread-2 : Unable to complete the scan: 'ascii' codec can't decode byte 0xc3 in position 42: ordinal not in range(128)"

[rembo10]

ahhh ok. I'm going to fix this soon

On Jul 15, 2011, at 5:54 PM, david81 wrote:

The normal music library import gives:

"15-Jul-2011 20:52:19 - ERROR :: CP Server Thread-2 : Unable to complete the scan: 'ascii' codec can't decode byte 0xc3 in position 42: ordinal not in range(128)"

Reply to this email directly or view it on GitHub:
#42 (comment)

[rembo10]

I'll fix the ascii errors tomorrow

[steve1977]

Thanks, this is great. Issue remains for me that I can basically not see albums for artists with "Umlauten" (ö, ä, ü), not even add artists with Asian characters or accents (é, ô). Guess all related to the same issue?

Thanks in advance!!!!

[rembo10]

For some reason I can't reproduce this. Are you guys all on windows?

17-Jul-2011 22:56:31 - INFO :: MainThread : Headphones is already up-to-date.
17-Jul-2011 22:56:32 - INFO :: MainThread : Starting Headphones on port: 8118
Exception in thread Thread-12:
Traceback (most recent call last):
File "/opt/lib/python2.7/threading.py", line 552, in __bootstrap_inner
self.run()
File "/opt/lib/python2.7/threading.py", line 505, in run
self.__target(_self.__args, *_self.__kwargs)
File "/volume1/@optware/share/headphones/headphones/importer.py", line 19, in scanMusic
for r,d,f in os.walk(unicode(dir)):
File "/opt/lib/python2.7/os.py", line 294, in walk
for x in walk(new_path, topdown, onerror, followlinks):
File "/opt/lib/python2.7/os.py", line 294, in walk
for x in walk(new_path, topdown, onerror, followlinks):
File "/opt/lib/python2.7/os.py", line 284, in walk
if isdir(join(top, name)):
File "/opt/lib/python2.7/posixpath.py", line 71, in join
path += '/' + b
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 31: ordinal not in range(128)

[fade23]

I am running Headphones itself on Gentoo Linux, while the files are shared via SMB/CIFS from an unRAID (Slackware Linux) server.

[bpierce815]

I am running headphones on fedora 14. Files are located locally on a USB harddrive.

[rembo10]

Alright I may have gotten a fix up. Please test and report back

[bpierce815]

Definately working better. Now getting good output in the logs. It's still having ascii issue with several files. But at least now it is moving past them. Here is the log output:

17-Jul-2011 16:41:35 - ERROR :: Thread-12 : Can not decode file 10 Put It in a Love Song (feat. Beyoncé).mp3. Error: 'ascii' codec can't decode byte 0xc3 in position 38: ordinal not in range(128)
17-Jul-2011 16:41:35 - ERROR :: Thread-12 : Can not decode file 11 Bre�a.mp3. Error: 'ascii' codec can't decode byte 0xf1 in position 6: ordinal not in range(128)
17-Jul-2011 16:41:35 - ERROR :: Thread-12 : Can not decode file 09 Renhold�r.mp3. Error: 'ascii' codec can't decode byte 0xeb in position 10: ordinal not in range(128)
17-Jul-2011 16:41:35 - ERROR :: Thread-12 : Can not decode file 18 Knockin’ on Heaven’s Door.mp3. Error: 'ascii' codec can't decode byte 0xe2 in position 10: ordinal not in range(128)
17-Jul-2011 16:41:35 - ERROR :: Thread-12 : Can not decode file 13 Beyoncé Interlude.mp3. Error: 'ascii' codec can't decode byte 0xc3 in position 9: ordinal not in range(128)
17-Jul-2011 16:41:36 - ERROR :: Thread-12 : Can not decode file 04 ¡Viva la Gloria!.mp3. Error: 'ascii' codec can't decode byte 0xc2 in position 3: ordinal not in range(128)
17-Jul-2011 16:41:36 - ERROR :: Thread-12 : Can not decode file 12 ¿Viva la Gloria_ (Little Girl).mp3. Error: 'ascii' codec can't decode byte 0xc2 in position 3: ordinal not in range(128)
17-Jul-2011 16:41:37 - ERROR :: Thread-12 : Can not decode file 05 N�guns.mp3. Error: 'ascii' codec can't decode byte 0xfc in position 4: ordinal not in range(128)
17-Jul-2011 16:41:38 - ERROR :: Thread-12 : Can not decode file 13 �nema.mp3. Error: 'ascii' codec can't decode byte 0xc6 in position 3: ordinal not in range(128)
17-Jul-2011 16:41:38 - ERROR :: Thread-12 : Can not decode file 12 Rivière.mp3. Error: 'ascii' codec can't decode byte 0xc3 in position 7: ordinal not in range(128)
17-Jul-2011 16:41:39 - INFO :: Thread-12 : 6104 music files found

[rembo10]

I can't for the life of me reproduce this, no matter what I try. Going to test it on linux now

[rembo10]

Special characters on Linux mint work fine too. Try the latest version and see if it's fixed

[steve1977]

Actually, I am using Win7x32. I can actually add artists with special characters. Issue is when marking albums as "wanted".

[rembo10]

Oh, i fixed that a fewcommits back. It should work fine

On Jul 17, 2011, at 8:59 PM, [email protected] wrote:

Actually, I am using Win7x32. I can actually add artists with special characters. Issue is when marking albums as "wanted".

Reply to this email directly or view it on GitHub:
#42 (comment)

[steve1977]

I believe this is fixed. I can now add artists with special characters and also select albums as wanted. I am not 100% sure whether it properly adds the albums that I have, but it appears to do so.

In my eyes, this issue can be closed. Thanks a lot for solving!!!

Sorry to disappoint you.

19-Jul-2011 06:34:22 - INFO :: MainThread : Headphones is already up-to-date.
19-Jul-2011 06:34:22 - INFO :: MainThread : Starting Headphones on port: 49194
Exception in thread Thread-12:
Traceback (most recent call last):
File "/opt/lib/python2.7/threading.py", line 552, in __bootstrap_inner
self.run()
File "/opt/lib/python2.7/threading.py", line 505, in run
self.__target(_self.__args, *_self.__kwargs)
File "/volume1/@optware/share/headphones/headphones/importer.py", line 19, in scanMusic
for r,d,f in os.walk(dir):
File "/opt/lib/python2.7/os.py", line 294, in walk
for x in walk(new_path, topdown, onerror, followlinks):
File "/opt/lib/python2.7/os.py", line 294, in walk
for x in walk(new_path, topdown, onerror, followlinks):
File "/opt/lib/python2.7/os.py", line 284, in walk
if isdir(join(top, name)):
File "/opt/lib/python2.7/posixpath.py", line 71, in join
path += '/' + b
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 31: ordinal not in range(128)

[rembo10]

What OS are you on? Is anyone else still getting the error?

It's a Synology NAS.

cube> uname -a
Linux cube 2.6.32.12 #1748 SMP Wed Jun 29 17:37:35 CST 2011 x86_64 GNU/Linux
cube> python -V
Python 2.7.2

Python was configured with --prefix=/opt --mandir=/opt/man --enable-shared --enable-unicode=ucs4 --enable-ipv6 'LDFLAGS= -L/opt/lib -Wl,-rpath,/opt/lib -Wl,-rpath-link,/opt/lib' 'CPPFLAGS=-O2 -O2 -pipe -I/opt/include' 'CPP=/opt/bin/gcc -E' (in case some of that info is needed)

[fade23]

Still no success here. It was partly working a few commits ago; when I ran Scan Music Library it would complain about the bad characters but keep going, and eventually start importing the stuff that it could. However, at some point it failed silently, and only ended up importing about 200 of the 650 artists I have. With the most recent commits, however, invoking Scan Music Library does nothing at all. Nothing is written to the logs.

[typhoe]

Hi,

I'm using Headphones on a NAS (Synology Linux nas 2.6.32.12 #1742 SMP Tue Jun 7 14:02:32 CST 2011 x86_64 GNU/Linux synology_x86_411+II) with python 2.6.

With the first versions of Headphones, I could scan my music folder and artists/albums where added.
Trying to scan the same folder again showed in the log that Headphones was scanning again.

With the latest ones, there was no "responses" I could see... (no entries in log, no error message).

So I tried to remove the Headphones.db file (keeping my config.ini one) and even though the db is recreated, I now get an error :

[code]
19-Jul-2011 16:09:42 - INFO :: MainThread : Checking to see if the database has all tables....
19-Jul-2011 16:09:43 - INFO :: MainThread : Headphones is already up-to-date.
19-Jul-2011 16:09:43 - INFO :: MainThread : Starting Headphones on port: 8083
Exception in thread Thread-12:
Traceback (most recent call last):
File "/usr/local/python26/lib/python2.6/threading.py", line 532, in bootstrap_inner
self.run()
File "/usr/local/python26/lib/python2.6/threading.py", line 484, in run
self.target(_self.args, *_self.kwargs)
File "/volume1/web/src/headphones/headphones/importer.py", line 19, in scanMusic
for r,d,f in os.walk(dir):
File "/usr/local/python26/lib/python2.6/os.py", line 284, in walk
if isdir(join(top, name)):
File "/usr/local/python26/lib/python2.6/posixpath.py", line 70, in join
path += '/' + b
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 9: ordinal not in range(128)
[/code]

any idea?

My music folder is /volume1/music/Albums (no special caracters here... but I indeed have a few special caracters in some artist names/albums/tracks...).

Thank you

[rembo10]

Alright, I'm going to focus on this til it's fixed - it's like 4 lines of code that's screwing everything up. I just need to figure out how to encode the characters so it works on all systems. It's like whack-a-mole

[rembo10]

Honestly I just can't reproduce this (tried win7, linux and osx - all work fine on artists like bjork, royksopp, etc).

If you guys are still having problems even after the update maybe I can have you run some tests on your system?

[david81]

Still getting the error here. Looks like at least one of the albums causing an issue is Les Misérables. I'm happy to run some tests if need be (Unraid/Slackware system).

[rembo10]

You want to chat on IM or something? Will be easier to figure it out

[typhoe]

Still getting the error too here.

I saw that two of us are using Synology NAS, so maybe the pb is related to that.

I'll be available to do any test you'll want in 2h.
IM on gtalk? Same as my nickname on Github.

[rembo10]

hey typhoe - yeah let's test. i started testing with david81 but I had to run out for a bit. are you around now?

[typhoe]

Yes, but I'll be on the move soon... and won't be able to test commands on my unit before 2h.
I can try a few now if it's quick.

[fade23]

I can help test as well. rglass on gtalk

[rembo10]

yeah i'm on gtalk right now - i'll keep an eye out for you guys.

rglass: are you running synology too?

On Jul 19, 2011, at 10:27 PM, fade23 wrote:

I can help test as well. rglass on gtalk

Reply to this email directly or view it on GitHub:
#42 (comment)

[fade23]

I am running Gentoo with an unRAID fileserver. I get the same results if I take unRAID out of the equation though and try completely local files.

[rembo10]

i'll message you on gtalk

On Jul 19, 2011, at 11:04 PM, fade23 wrote:

I am running Gentoo with an unRAID fileserver. I get the same results if I take unRAID out of the equation though and try completely local files.

Reply to this email directly or view it on GitHub:
#42 (comment)

[typhoe]

I'm available now if you still need me.

[rembo10]

awesome - yeah let's do it. I added you on gtalk so when you sign on we can get started

you can download a testfile I made here:
http://dl.dropbox.com/u/9306002/headphonestest.zip

are you able to edit text files on your nas?

On Jul 20, 2011, at 12:11 AM, typhoe wrote:

I'm available now if you still need me.

Reply to this email directly or view it on GitHub:
#42 (comment)

[typhoe]

yes, I can edit on my nas.

Juste grabed your file, launched test.py.

bash-3.2# /usr/local/python26/bin/python test.py
Scanning dir: /Users/rembo/Music
Test Succeeded!

Changed the music dir (yours obviously didn't exist on my nas ;-) )
bash-3.2# vim test.py
bash-3.2# ls -l /volume1/music/Albums
drwxrwxrwx 3 admin users 4096 Jun 11 18:23 4Hero
drwxrwxrwx 10 admin users 4096 Jun 11 18:22 A-Ha
<....>
bash-3.2# /usr/local/python26/bin/python test.py
Scanning dir: /volume1/music/Albums

It's still running...and I see no logs...

I'm already online, you should be able to see me

[rembo10]

Send me tracebacks of the error - I think I've got it nailed down to how to fix it

Seems to be only on systems where the encoding is not declared, so I'll have to set that manually

On Jul 20, 2011, at 12:36 AM, typhoe wrote:

yes, I can edit on my nas.

Juste grabed your file, launched test.py.

bash-3.2# /usr/local/python26/bin/python test.py
Scanning dir: /Users/rembo/Music
Test Succeeded!

Changed the music dir (yours obviously didn't exist on my nas ;-) )
bash-3.2# vim test.py
bash-3.2# ls -l /volume1/music/Albums
drwxrwxrwx 3 admin users 4096 Jun 11 18:23 4Hero
drwxrwxrwx 10 admin users 4096 Jun 11 18:22 A-Ha
<....>
bash-3.2# /usr/local/python26/bin/python test.py
Scanning dir: /volume1/music/Albums

It's still running...and I see no logs...

I'm already online, you should be able to see me

Reply to this email directly or view it on GitHub:
#42 (comment)

[wangel]

This is the latest error I am getting:

File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
self.run()
File "/usr/lib/python2.6/threading.py", line 484, in run
self.__target(_self.__args, *_self.__kwargs)
File "/home/wangel/headphones/headphones/importer.py", line 19, in scanMusic
for r,d,f in os.walk(dir):
File "/usr/lib/python2.6/os.py", line 284, in walk
if isdir(join(top, name)):
File "/usr/lib/python2.6/posixpath.py", line 70, in join
path += '/' + b
UnicodeDecodeError: 'ascii' codec can't decode byte 0x99 in position 6: ordinal not in range(128)

I am running Ubuntu server 10.10. The music files are located on a NAS mounted thru Samba....

[rembo10]

Just want to let you guys know I haven't forgotten about this. In fact, it's pretty much the only thing I've been trying to fix for the past few days but it seems like the function i'm calling (os.walk and os.path.join) don't play that well on certain *nix systems because no specific encoding is declared. so a string could have a bunch of different encoding in it.

there are some things you can do on your end to make it work (mainly, declaring an encoding type or locale) but i'd rather handle it on my end.

[Zeron]

I still get this issue as of 1be25c6
Ubuntu 10.04 with medialibrary mounted via SMB

Exception in thread Thread-12:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/dan/.headphones/headphones/importer.py", line 18, in scanMusic
    for r,d,f in os.walk(dir):
  File "/usr/lib/python2.6/os.py", line 284, in walk
    if isdir(join(top, name)):
  File "/usr/lib/python2.6/posixpath.py", line 70, in join
    path += '/' + b
UnicodeDecodeError: 'ascii' codec can't decode byte 0x81 in position 8: ordinal not in range(128)

[wangel]

rembo;

  Would having access to a linux box help you at all (assuming you don't have one, heh)

[rembo10]

Wangel - Yes totally! Rigjt now I'm just kinda stumbling in the dark hoping something will work. Pm me

On Jul 21, 2011, at 8:43 AM, [email protected] wrote:

rembo;

 Would having access to a linux box help you at all (assuming you don't have one, heh)

Reply to this email directly or view it on GitHub:
#42 (comment)

[rembo10]

Alright thanks to typhoe, fade23 and wangel I got a fix for hopefully most of you. The problem was mounting smb drives with no encoding declared, while running headphones on another system.

If you use smbmount, for example, 'smbmount //volume/music /Music' will cause an ascii error. But if you declare the encoding while mounting, it will work fine. Nothing I do in my code can change the way your drive is mounted.

If you use smbmount, running 'smbmount //volume/music /Music -o iocharset=utf8' causes no more issues! Just make sure you have permissions to read the mount point and that the path you put into Headphones is correct as it seems to be case-sensitive on Linux (not sure about Windows but better safe than sorry :))

You may need to adjust the command above depending on how you're mounting your drives. Just make sure you set the encoding to utf8. Google 'mount smb utf8 linux' for more info

[wangel]

Confirmed. This works for me.

I used this command:

smbmount //hostname/sharename /mntpoint -o user=username,pass=password,iocharset=utf8

Thanks for checking this out rembo!

Glad I was able to help a bit =)

[typhoe]

Well, that could be difficult to do for me...

I'm using a nas (synology).

Both my music and headphones are on it.

I'm not mounting my music dir with a cifs/smb share, that's direct access.

[fade23]

You can also accomplish this locally on a Linux system by configuring the Locale settings. Here's how to do it in Gentoo Linux: http://www.gentoo.org/doc/en/guide-localization.xml; other distributions may vary slightly but should have similar functionality. Once I performed these steps on my system Headphones is now happily scanning all of my albums, including those with non-English characters.

Synology doesn't provide locale-files.

[rembo10]

I found this that might help: http://forum.serviio.org/viewtopic.php?f=14&t=692&p=5572&hilit=hebrew#p5832

[typhoe]

I've been trying set the LANG env setting... When I do, headphones launch but the web server seems to crash (no log)...
Can we talk in gtalk?

[rembo10]

Thank to typhoe I think I got a fix up for you guys running headphones on a nas. Give the new version a try.

On Jul 22, 2011, at 1:40 AM, [email protected] wrote:

I've been trying set the LANG env setting... When I do, headphones launch but the web server seems to crash (no log)...
Can we talk in gtalk?

Reply to this email directly or view it on GitHub:
#42 (comment)

[david81]

Just started another music scan and things definitely are going better now. No errors in the logs yet.

[rembo10]

nice! the only try/except clause i have in there now is if beets can't read the metadata. otherwise consider your music scanned!

still gonna wait for a little more feedback before i close the issue

On Jul 22, 2011, at 5:25 PM, david81 wrote:

Just started another music scan and things definitely are going better now. No errors in the logs yet.

Reply to this email directly or view it on GitHub:
#42 (comment)

[MikeBuzz]

31-Jul-2011 17:49:03 - ERROR :: Thread-12 : Error renaming file: /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/02 Michael Buble - It Had Better Be Tonight [Meglio Stasera].mp3. Error: 'ascii' codec can't encode character u'\xe9' in position 96: ordinal not in range(128)

31-Jul-2011 17:49:03 - DEBUG :: Thread-12 : Renaming /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/02 Michael Buble - It Had Better Be Tonight [Meglio Stasera].mp3 ---> 02 Michael Bublé - Call Me Irresponsible - It Had Better Be Tonight.mp3

have only just started getting these errors

[rembo10]

I'll look into this, have you looked at the fixes above?

On Jul 31, 2011, at 9:53 AM, [email protected] wrote:

31-Jul-2011 17:49:03 - ERROR :: Thread-12 : Error renaming file: /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/02 Michael Buble - It Had Better Be Tonight [Meglio Stasera].mp3. Error: 'ascii' codec can't encode character u'\xe9' in position 96: ordinal not in range(128)

31-Jul-2011 17:49:03 - DEBUG :: Thread-12 : Renaming /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/02 Michael Buble - It Had Better Be Tonight [Meglio Stasera].mp3 ---> 02 Michael Bublé - Call Me Irresponsible - It Had Better Be Tonight.mp3

have only just started getting these errors

Reply to this email directly or view it on GitHub:
#42 (comment)

[MikeBuzz]

all the loacale settings are set to en_gb so should be fine

[rembo10]

Are you using the forced post processing?

On Jul 31, 2011, at 9:53 AM, [email protected] wrote:

31-Jul-2011 17:49:03 - ERROR :: Thread-12 : Error renaming file: /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/02 Michael Buble - It Had Better Be Tonight [Meglio Stasera].mp3. Error: 'ascii' codec can't encode character u'\xe9' in position 96: ordinal not in range(128)

31-Jul-2011 17:49:03 - DEBUG :: Thread-12 : Renaming /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/02 Michael Buble - It Had Better Be Tonight [Meglio Stasera].mp3 ---> 02 Michael Bublé - Call Me Irresponsible - It Had Better Be Tonight.mp3

have only just started getting these errors

Reply to this email directly or view it on GitHub:
#42 (comment)

[MikeBuzz]

Nope, just letting it scan itself, it must be as its trying to rename them using an accent over the last e in the artist name..

maybe i could test with different locale settings

[MikeBuzz]

Just been reading through the above posts, it would seem everything is processed fine its just when its trying to rename the files using the non standard characters thats causing my problem, not sure if anyone could test with a standard install of Ubuntu 10.10

[MikeBuzz]

have now got it remaning the files but now have a different issue

01-Aug-2011 19:27:56 - DEBUG :: Thread-12 : Renaming /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/13 Michael Buble - Dream.mp3 ---> 13 Michael Bublé - Call Me Irresponsible - Dream.mp3

as you can see getting ã© instead of é

had to add the following the /etc/default/locale to get this far

LANG="en_GB.UTF-8"
LANGUAGE="en_GB:en"

any ideas why i am still getting the mistakes

[rembo10]

is it actually renaming the files to that, or is it just showing up like that in the logs? haven't tested much on anything other than osx but i did notice on win7 it would show up like that in the logs, but in the console it would be find and it renamed the files properly

I'll fix all these ascii errors soon - you shouldn't have to edit your locale

On Aug 1, 2011, at 11:34 AM, MikeBuzz wrote:

have now got it remaning the files but now have a different issue

01-Aug-2011 19:27:56 - DEBUG :: Thread-12 : Renaming /home/xbmc/downloads/complete/Music/Michael Buble - Call Me Irresponsible [2007]/13 Michael Buble - Dream.mp3 ---> 13 Michael Bublé - Call Me Irresponsible - Dream.mp3

as you can see getting ã© instead of é

had to add the following the /etc/default/locale to get this far

LANG="en_GB.UTF-8"
LANGUAGE="en_GB:en"

any ideas why i am still getting the mistakes

Reply to this email directly or view it on GitHub:
#42 (comment)

[MikeBuzz]

Looking at the share via smb it has named then with the correct Michael Bublé but when ls on the linux box its Michael Bublé

have been looking round seems that sickbreard has had the same issue in the past but no idea when he had to do to fix it

[rembo10]

I'll take a look at how sickbeard's renaming files. It handles encodings way better than headphones but im workin on it

On Aug 1, 2011, at 12:38 PM, [email protected] wrote:

Looking at the share via smb it has named then with the correct Michael Bublé but when ls on the linux box its Michael Bublé

have been looking round seems that sickbreard has had the same issue in the past but no idea when he had to do to fix it

Reply to this email directly or view it on GitHub:
#42 (comment)

[MikeBuzz]

Thanks for all your hard work its much appreciated, if you need me to test anything let me know

[rembo10]

Thanks, I'm still figuring out github so hopefully soon I can start making some test branches for stuff like this :-)

On Aug 1, 2011, at 2:00 PM, [email protected] wrote:

Thanks for all your hard work its much appreciated, if you need me to test anything let me know

Reply to this email directly or view it on GitHub:
#42 (comment)

[rembo10]

I think I might have a fix. Testing it now

On Aug 1, 2011, at 2:00 PM, MikeBuzz wrote:

Thanks for all your hard work its much appreciated, if you need me to test anything let me know

Reply to this email directly or view it on GitHub:
#42 (comment)

[MikeBuzz]

let me know if you need me to test, thanks again