MegaFuse hangs

[matteoserva]

MegaFuse hangs

[matteoserva]

The upload fails for some reason, probably because of invalid characters in the file name.
I pushed a patch that fixes the deadlock when the upload fails.

[maarts]

Hi,

thanks, it works!

Before I use mega with MegaFuse, I use Ubuntu One with u1ftp and there was accepted all these encfs stuff. Is there a opportunity in MegaFuse to fix the issue with the invalid characters?

Thanks!

[maarts]

Hi,

After a while of testing crashes MegaFuse. For the test I use cp. Rsync crashes too.

Is this a general issue?

In the first time I copy via rsync 1400 files (encfs stuff) without any problems to mega.

[matteoserva]

I pushed a new patch that will hopefully solve the crash problem.
what are the last messages when megafuse crashes?

[maarts]

Hi,

here is the output after stop cp.

output cp:

cp: reguläre Datei „/mnt/files/encfs/encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/0EMzMJ009vvilCkTJ3e4D4Dl“ kann nicht angelegt werden: Das numerische Ergebnis ist außerhalb des gültigen Bereiches
cp: reguläre Datei „/mnt/files/encfs/encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/h5OrnWXItKFVWDbJgnpDQSj7“ kann nicht angelegt werden: Das numerische Ergebnis ist außerhalb des gültigen Bereiches

output MegaFuse:

flags:20001
searching node by path: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/-337l-T7xXLr3qBx8GvzNfdZ
node found in MEGA: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/-337l-T7xXLr3qBx8GvzNfdZ
creato il file /tmp/fileaS0B6e
searching node by path: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/-337l-T7xXLr3qBx8GvzNfdZ
node found in MEGA: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/-337l-T7xXLr3qBx8GvzNfdZ
topen riuscito

download complete

file: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/-337l-T7xXLr3qBx8GvzNfdZ ora in stato DOWNLOADING
/usr/include/c++/4.6/debug/vector:313:error: attempt to subscript container 
    with out-of-bounds index 0, but container only holds 0 elements.

Objects involved in the operation:
sequence "this" @ 0x0x20d4940 {
  type = NSt7__debug6vectorIbSaIbEEE;
}

[maarts]

Hi,

MegaFuse crashes via rsync:

flags:20000
searching node by path: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/,015I8ahbkV,JSWFNcYk-ztg
node found in MEGA: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/,015I8ahbkV,JSWFNcYk-ztg
creato il file /tmp/filewuTAbg
searching node by path: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/,015I8ahbkV,JSWFNcYk-ztg
node found in MEGA: /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/,015I8ahbkV,JSWFNcYk-ztg
topen fallito!

[maarts]

Hi,

with the new version (commit 140) and rsync crashes MegaFuse:

--------requested rename from /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/.,0mBzw7A-SgvlqI,MdPipiY1.D32x0E to /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/,0mBzw7A-SgvlqI,MdPipiY1
1 file removed
fullpath /encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/,0mBzw7A-SgvlqI,MdPipiY1
/usr/include/c++/4.6/debug/vector:313:error: attempt to subscript container 
    with out-of-bounds index 0, but container only holds 0 elements.

Objects involved in the operation:
sequence "this" @ 0x0xbd5588 {
  type = NSt7__debug6vectorIP4NodeSaIS2_EEE;
}

[maarts]

Hi,

with cp it works!

[maarts]

so, I play a little bit with cp. If I copy files for the first time to mega, MegaFuse works like a charm. But if I copy the same files once more with a difference of files, cp gives this output:

cp:

cp: reguläre Datei „/mnt/files/encfs/encfs_1/NoPWHHBeetddaYHReqpYE6TS/okbPu9LzGsGd,-jfJumOlO4-/52z3RGPNQsgUoWFmz7LQaCyH/WcdJpbufcvMf3-K3DuiD6Fjw/iEfD-1i6wc6HBHg7f0WOdf-e/ncXZDrNC3MRybo9fLUvwXLn7“ kann nicht angelegt werden: Das numerische Ergebnis ist außerhalb des gültigen Bereiches

I think there is a general issue with file update (see rsync crash).

[matteoserva]

I tested cp and it works fine. did you test it with shorter filenames?
MEGA allows multiple files to have the same name, MegaFuse first uploads the new file then deletes the old one

[maarts]

I play a little bit more with shorter filenames, but cp crashes here too:

searching node by path: /test/sdsdtttt
node found in MEGA: /test/sdsdtttt
creato il file /tmp/filebekuJ8
searching node by path: /test/sdsdtttt
node found in MEGA: /test/sdsdtttt
API request failed, retrying in 100 ms - Use 'retry' to retry immediately...
unlink eseguito
topen riuscito

download complete

file: /test/sdsdtttt ora in stato DOWNLOADING
/usr/include/c++/4.6/debug/vector:313:error: attempt to subscript container 
    with out-of-bounds index 0, but container only holds 0 elements.

Objects involved in the operation:
sequence "this" @ 0x0x1029ca0 {
  type = NSt7__debug6vectorIbSaIbEEE;
}

Rsync crashes every time. :(

[matteoserva]

I'm still unable to reproduce this bug. Apparently Megafuse is trying to download the file while it is uploading it. did you try with cp alone? I suspect that rsync corrupts some megafuse data and then cp fails because that data is corrupted

[maarts]

Hi,

I found the problem!

With a normal desktop (ubuntu 12.04) all works fine without any issues. On my Raspberry Pi with raspbian I have the above described issues.

Do you have an idea, why the Raspberry Pi produces this issues with the recopy?

[matteoserva]

still trying to understand why.
did you compile megafuse on the rasPI?
is the rasPI using debian?

[maarts]

Hi,

I compile MegaFuse on the RPI without any problems. I use Raspbian = Debian Wheezy.

The main issue is the recopy of the same files. At the first copy all works great.

[maarts]

Hi,

I build a qemu-kernel for ARM1176. So, I am able to run MegaFuse in qemu with the same issues like the real machine.

Do you want to use the qemu machine for debugging?

[matteoserva]

yes thanks. I'm not experienced with linux on arm but I'll try to find out what's the problem

[chaoscommander]

Digging this up to add that hanging also randomly occurs using Duplicity. Not sure if this is always the problem (since I usually just reboot the machine, having no time for debugging), but in the case that just happened to me, MegaFuse stopped in the middle of a download, saying "download fallito -5" and refused to be killed by anything less than kill -9 (also keeping me from killing Duplicity). Could that lockup also be fixed, so that a failed download is automatically retried maybe?

[chaoscommander]

...Bump?