[Bug]: Office files are corrupted/emptied after some time

[cyberb]

[Bug]: Office files are corrupted/emptied after some time

[joshtrichards]

Can you look in your Nextcloud server logs for entries mentioning one of these corrupted files? Both entries mentioning the file and immediately before it would be of interest.

Also, what external Collabora Online version/edition are you using?

Lastly, to clarify, you are able to edit in one place (i.e. web) the same file... Then go to your phone's Nextcloud client and edit the file successfully? But the. later the file disappears? Does it ever disappear prior to accessing from a second device?

[cyberb]

Sorry I do not have logs now, but when I checked both nextcloud and collabora logs they had no exceptions and looked similar to other files.

Also, what external Collabora Online version/edition are you using?

I am actually extracting binaries from their docker image: collabora/code:21.11.4.2.1
And then I convert it to a snap package: https://github.com/syncloud/collabora/blob/master/app/Dockerfile

1. I am able edit on the web and collabora web opens. Auto saves and I leave it running.
2. Then continue adding more stuff on the mobile. Now as I opened the file again actually it is collabora mobile app
3. Then opened on the web again and it was empty.

I can try to reproduce it to give more details, maybe it is related to user session exporation or something else.

[cyberb]

Ok just tried to repro and it happened again!

1. Create a new file on Nextcloud Android (test1.ods) embedded collabora calc opens (looks like embedded web one, not my collabora mobile app) add few test entries. Save. Not close.
2. Open nextcloud we in firefox same mobile phone. File exists but empty.
3. Go back to Nextcloud mobile app with open file, not it says taking too long to open (it was actually open, but I guess app switch causes to reload file). Click cancel, reopen file again and it is empty now.

Logs from Nextcloud server:

root@syncloud:~# journalctl -u snap.nextcloud.* | grep test1.ods
Nov 11 08:41:53 syncloud nginx[2915]: syncloud nginx: *** - boris [11/Nov/2023:08:41:53 +0000] "PROPFIND /remote.php/dav/files/boris/Temp/test1.ods HTTP/1.1" 207 1308 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.26.0"
Nov 11 08:43:28 syncloud nginx[2914]: syncloud nginx: ***  - - [11/Nov/2023:08:43:28 +0000] "GET /apps/files/?dir=/Temp&openfile=1322457&scrollto=test1.ods HTTP/1.1" 200 16904 "-" "Mozilla/5.0 (Android 10; Mobile; rv:109.0) Gecko/119.0 Firefox/119.0"
Nov 11 08:43:33 syncloud nginx[2914]: syncloud nginx: ***  - - [11/Nov/2023:08:43:33 +0000] "GET /ocs/v2.php/search/providers?from=%2Fapps%2Ffiles%2F%3Fdir%3D%2FTemp%26openfile%3D1322457%26scrollto%3Dtest1.ods HTTP/1.1" 200 277 "-" "Mozilla/5.0 (Android 10; Mobile; rv:109.0) Gecko/119.0 Firefox/119.0"
Nov 11 08:43:38 syncloud nginx[2915]: syncloud nginx: ***  - - [11/Nov/2023:08:43:38 +0000] "PROPFIND /remote.php/dav/files/boris/Temp/test1.ods HTTP/1.1" 207 585 "-" "Mozilla/5.0 (Android 10; Mobile; rv:109.0) Gecko/119.0 Firefox/119.0"
Nov 11 08:44:22 syncloud nginx[2915]: syncloud nginx: ***  - boris [11/Nov/2023:08:44:22 +0000] "GET /index.php/apps/files/api/v1/thumbnail/256/256/Temp/test1.ods HTTP/1.1" 404 29 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.26.0"

Collabora server logs:

journalctl -u snap.collabora.* | grep test1.ods
Nov 11 08:41:57 syncloud collabora.server[497]: wsd-01320-02476 2023-11-11 08:41:57.706792 +0000 [ websrv_poll ] INF  nextcloud/server#21: Client HTTP Request: POST /browser/3eff190/cool.html?WOPISrc=https%3A%2F%2Fnextcloud.***.syncloud.it%2Findex.php%2Fapps%2Frichdocuments%2Fwopi%2Ffiles%2F1322457_ocy0e4tzvl95&title=test1.ods&lang=en-GB&closebutton=1 HTTP/1.0 / Host: collabora.***.syncloud.it / Connection: close / Content-Length: 4246 / X-Forwarded-Proto: https / X-Forwarded-Host: collabora.***.syncloud.it / X-Real-IP: *** / X-Forwarded-For: *** / cache-control: max-age=0 / sec-ch-ua: "Chromium";v="118", "Android WebView";v="118", "Not=A?Brand";v="99" / sec-ch-ua-mobile: ?1 / sec-ch-ua-platform: "Android" / upgrade-insecure-requests: 1 / origin: null / content-type: application/x-www-form-urlencoded / user-agent: Mozilla/5.0 (Android) Nextcloud-android/3.26.0 / accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7 / x-requested-with: com.nextcloud.client / sec-fetch-site: same-site / sec-fetch-mode: navigate / sec-fetch-dest: iframe / accept-encoding: gzip, deflate, br / accept-language: en-GB,en-US;q=0.9,en;q=0.8| net/Socket.cpp:1071
Nov 11 08:41:57 syncloud nginx[1388]: syncloud nginx: *** - - [11/Nov/2023:08:41:57 +0000] "POST /browser/3eff190/cool.html?WOPISrc=https%3A%2F%2Fnextcloud.***.syncloud.it%2Findex.php%2Fapps%2Frichdocuments%2Fwopi%2Ffiles%2F1322457_ocy0e4tzvl95&title=test1.ods&lang=en-GB&closebutton=1 HTTP/1.1" 200 31706 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.26.0"
Nov 11 08:41:58 syncloud collabora.server[497]: kit-13368-01946 2023-11-11 08:41:58.305061 +0000 [ kitbroker_00a ] INF  Saving the template document after loading to [file:///var/snap/collabora/current/child-roots/vxu5YoKVNakdaJVc//var/snap/collabora/current/child-roots/vxu5YoKVNakdaJVc/tmp/user/docs/vxu5YoKVNakdaJVc/test1.ods].| kit/ChildSession.cpp:741
Nov 11 08:41:58 syncloud collabora.server[497]: wsd-01320-01325 2023-11-11 08:41:58.607738 +0000 [ docbroker_00a ] ERR  Expected to renamed the document [/var/snap/collabora/current/child-roots/vxu5YoKVNakdaJVc/tmp/user/docs/vxu5YoKVNakdaJVc/test1.ods.upload] after template-loading to [/var/snap/collabora/current/child-roots/vxu5YoKVNakdaJVc/tmp/user/docs/vxu5YoKVNakdaJVc/test1.ods.uploading] (ENOENT: No such file or directory)| wsd/DocumentBroker.cpp:1379
Nov 11 08:41:59 syncloud collabora.server[497]: wsd-01320-01325 2023-11-11 08:41:59.338410 +0000 [ docbroker_00a ] ERR  Expected to renamed the document [/var/snap/collabora/current/child-roots/vxu5YoKVNakdaJVc/tmp/user/docs/vxu5YoKVNakdaJVc/test1.ods.upload] after template-loading to [/var/snap/collabora/current/child-roots/vxu5YoKVNakdaJVc/tmp/user/docs/vxu5YoKVNakdaJVc/test1.ods.uploading] (ENOENT: No such file or directory)| wsd/DocumentBroker.cpp:1379
Nov 11 08:43:38 syncloud collabora.server[497]: wsd-01320-02476 2023-11-11 08:43:38.756012 +0000 [ websrv_poll ] INF  nextcloud/server#21: Client HTTP Request: POST /browser/3eff190/cool.html?WOPISrc=https%3A%2F%2Fnextcloud.***.syncloud.it%2Findex.php%2Fapps%2Frichdocuments%2Fwopi%2Ffiles%2F1322457_ocy0e4tzvl95&title=%2FTemp%2Ftest1.ods&lang=en-GB&closebutton=1&revisionhistory=1 HTTP/1.0 / Host: collabora.***.syncloud.it / Connection: close / Content-Length: 4233 / X-Forwarded-Proto: https / X-Forwarded-Host: collabora.***.syncloud.it / X-Real-IP: *** / X-Forwarded-For: *** / user-agent: Mozilla/5.0 (Android 10; Mobile; rv:109.0) Gecko/119.0 Firefox/119.0 / accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8 / accept-language: en-GB / accept-encoding: gzip, deflate, br / content-type: application/x-www-form-urlencoded / origin: null / upgrade-insecure-requests: 1 / sec-fetch-dest: iframe / sec-fetch-mode: navigate / sec-fetch-site: same-site| net/Socket.cpp:1071
Nov 11 08:43:38 syncloud nginx[1391]: syncloud nginx: *** - - [11/Nov/2023:08:43:38 +0000] "POST /browser/3eff190/cool.html?WOPISrc=https%3A%2F%2Fnextcloud.***.syncloud.it%2Findex.php%2Fapps%2Frichdocuments%2Fwopi%2Ffiles%2F1322457_ocy0e4tzvl95&title=%2FTemp%2Ftest1.ods&lang=en-GB&closebutton=1&revisionhistory=1 HTTP/1.1" 200 31694 "-" "Mozilla/5.0 (Android 10; Mobile; rv:109.0) Gecko/119.0 Firefox/119.0"
Nov 11 08:44:28 syncloud collabora.server[497]: wsd-01320-02476 2023-11-11 08:44:28.980647 +0000 [ websrv_poll ] INF  nextcloud/server#21: Client HTTP Request: POST /browser/3eff190/cool.html?WOPISrc=https%3A%2F%2Fnextcloud.***.syncloud.it%2Findex.php%2Fapps%2Frichdocuments%2Fwopi%2Ffiles%2F1322457_ocy0e4tzvl95&title=test1.ods&lang=en-GB&closebutton=1 HTTP/1.0 / Host: collabora.***.syncloud.it / Connection: close / Content-Length: 4246 / X-Forwarded-Proto: https / X-Forwarded-Host: collabora.***.syncloud.it / X-Real-IP: *** / X-Forwarded-For: *** / cache-control: max-age=0 / sec-ch-ua: "Chromium";v="118", "Android WebView";v="118", "Not=A?Brand";v="99" / sec-ch-ua-mobile: ?1 / sec-ch-ua-platform: "Android" / upgrade-insecure-requests: 1 / origin: null / content-type: application/x-www-form-urlencoded / user-agent: Mozilla/5.0 (Android) Nextcloud-android/3.26.0 / accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7 / x-requested-with: com.nextcloud.client / sec-fetch-site: same-site / sec-fetch-mode: navigate / sec-fetch-dest: iframe / accept-encoding: gzip, deflate, br / accept-language: en-GB,en-US;q=0.9,en;q=0.8| net/Socket.cpp:1071
Nov 11 08:44:28 syncloud nginx[1391]: syncloud nginx: ***  - - [11/Nov/2023:08:44:28 +0000] "POST /browser/3eff190/cool.html?WOPISrc=https%3A%2F%2Fnextcloud.***.syncloud.it%2Findex.php%2Fapps%2Frichdocuments%2Fwopi%2Ffiles%2F1322457_ocy0e4tzvl95&title=test1.ods&lang=en-GB&closebutton=1 HTTP/1.1" 200 31706 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.26.0"

[cyberb]

All versions are empty now.

[joshtrichards]

Logs from Nextcloud server:

Those are all helpful, but these logs are from your web server (Nginx) not Nextcloud Server. Can you share those from the same time period? Thanks.

Oh also since some things (like errors) may not be logged with the user filename, can you share the Collabora logs for that time window rather than just grep'd by filename?

Also going to move this Issue over to the richdocuments repository for now.

[cyberb]

Just reproduced again using the same workflow, there is nothing from nextcloud itself, usually I have it in the same output from systemd as I run it using snap.nextcloud.phpfpm process.

Also I have this in the config:

 'log_type' => 'syslog',

[cyberb]

I can try upgrading collabora to 23.05.5.3.1 to see if that helps, at least I can reproduce it now.

[cyberb]

Ok, upgrade to 23.05.5.3.1 actually helped at least now I cannot reproduce the isssue, I will reopen if it happens again.

[cyberb]

Sorry the problem is there still.
Yesterday I eas testing a file and was switching between mobile app and web collabora integrations, eberything was fine and changes instantly visible.
Today opened the same file on the web and it is empty and history shows empty changes.

[cyberb]

I will try to get more logs

[marcinkuk]

I heve exacltly the same issue with my nextclouds.
Have several nextcloud environements with different version and collabora or nextcloud sometimes eat my files.
I lost a lot of work.

[pehlert]

Same here, ods file completely empty after a while, showing the same size (683 B) for all versions.

Needless to say this is disastrous for a software who's main purpose is so safely store files.

[voggur]

Same bug as: Document content is not saved when it was just created ?

[artfulrobot]

This is a terrifying bug! Glad I found this report in time, I was going to recommend nextcloud office to a client, but I would be pilloried if this happened to their docs! As I understand, Nextcloud passes the file to CODE which then somehow passes it back after an update, which makes sense, but blanking all the previous versions?! I don't get that at all.

Not sure if it's related (and will check the issue queue) but I get similarly weird behaviours with Excalidraw - like content is just not there, or is old etc. Figured it could be related as it's another case of pass the doc out somewhere and store it when updated.