nextcloud/docker-ci

:package: Containers used for Continous Integration jobs (automated testing)

CI images for Nextcloud

📦 Containers used for Continous Integration jobs (automated testing)

GitHub Container Registry

The images are automatic builds on GitHub actions. You can find them at https://github.com/orgs/nextcloud/packages?repo_name=docker-ci. The build is triggered using GitHub workflows.

GitHub workflows

To trigger a build of a specific container, go to https://github.com/nextcloud/docker-ci/actions/workflows/docker.yml and press "Run Workflow". Enter the following information:

• Path to the folder (e.g. translations)
• Path to Dockerfile: Dockerfile-Plain IMPORTANT: If you are not using Dockerfile but one with a suffix here, you also need to add the suffix on the image name in the next field (all lowercased)
• Suffix to image name: -plain
• Tag name (e.g. latest)

This would result in the Dockerfile /client/Dockerfile being built and the binary being pushed to the GitHub Container Registry as client:latest.

Docker Hub

The images are automatic builds on Docker Hub. You can find them at https://hub.docker.com/u/nextcloudci/. The build is only triggered if a git tag is set.

Git tags

To trigger a build of a specific container the tag needs to be named like the folder followed by a dash and a version number. This means translations-1 will only trigger a build of the translation container and will then build the container nextcloudci/translations:translations-1.

Other example:

• git tag php7.1-5 will only build nextcloudci/php7.1:php7.1-5

docker-ci's Issues

translationtool: `/.l10nignore` vs. `/l10n/ignorelist`

What is the state of the art for excluding files from being translated?

If I understand this correctly, /l10n/ignorelist was used by the old l10n.pl and /.l10nignore is used by the new translationtool.php. Is this correct?

Why I'm asking: translationtool.php has a method readIgnoreList() which reads from /l10n/ignorelist and returns the content. This method is called from createPotFile() in line 64 (https://github.com/nextcloud/docker-ci/blob/master/translations/translationtool/src/translationtool.php#L64). However, the result is not used!

Hence, the content of /l10n/ignorelist is totally ignored. If this is intended, we should remove the method readIgnoreList(). Otherwise (backward-compatibility?), the result of that method has to be used correctly.

Drop obsolete versions of PHP

This repository is getting crowded.

Can I open a PR to drop all images specific to PHP versions below 7.3 that have an equivalent for a newer version?

Maybe keep 7.2 as well, if needed to test things on older Nextcloud versions (7.2 support was dropped in Nextcloud 21, 7.1 in 18 according to documentation).

Bump Android container for gradle 4.6 and Android gradle 3.2.0

@tobiasKaminsky do you have the time to take care of this?
Due to the latest dependency bumps the builds now have to download gradle/android-gradle again.

nextcloud-bot invite pending for about a week now

Appointments app: https://github.com/SergeyMosin/Appointments

Please add ncdownloader for translation

Add project "diary" to Transifex sync

• App repo: Add .tx folder including config -> @danielroehrig
• App repo: Add ignore file -> @danielroehrig
• App repo: Add l10n folder -> @danielroehrig
• App repo: Invite "nextcloud bot" with write permissions -> @danielroehrig
• docker-ci: add repo info to config.json -> @danielroehrig #373
• Sysadmins of NC: Deploy internally to tx sync process -> @blizzz
• Transifex: New resource should appear -> rakekniven
• Transifex: Do translations and check sync to repo -> rakekniven

Add project "audioplayer" to Transifex sync

• App repo: Add .tx folder including config -> @Rello
• App repo: Add ignore file -> @Rello
• App repo: Add l10n folder -> @Rello
• App repo: Invite "nextcloud bot" with write permissions -> @Rello
• docker-ci: add repo info to config.json -> rakekniven #330
• Sysadmins of NC: Deploy internally to tx sync process -> @blizzz
• Transifex: New resource should appear -> rakekniven
• Transifex: Do translations and check sync to repo -> rakekniven

Deploy improvement for translation of vue files

@nickvergessen Has this improvement been deployed internally at NC?
Some new changes in vue files at GitHub does not show expected developer notes.

Originally posted by @rakekniven in #321 (comment)

Add project "files_scripts" to Transifex sync

• App repo: Add .tx folder including config -> @Raudius
• App repo: Add ignore file -> @Raudius
• App repo: Add l10n folder -> @Raudius
• App repo: Invite "nextcloud bot" with write permissions -> @Raudius
  • Invite pending
• docker-ci: add repo info to config.json -> #381
• Sysadmins of NC: Deploy internally to tx sync process ->
• Transifex: New resource should appear -> @rakekniven
• Transifex: Do translations and check sync to repo -> @rakekniven
• Add resource to wiki -> @rakekniven

When translated strings for a language fall below 50%, they are not removed on Android

When a translated language falls below the 50% mark, they won't get pushed anymore back from transifex to the upstream repository.

To avoid outdated translations in the upstream repository, there is a delete command to clean up such little translated but no longer pushed languages:
https://github.com/nextcloud/docker-ci/blob/master/translations/handleAppTranslations.sh#L80-L81

It seems though, that this will only affect json and js files, but translations for Android apps are stored in xml files which are not covered by the rm.

I am not sure whether or not this issue can simply be solved by adding xml to the list of file extensions in this line, therefore just opening an issue instead of a direct PR.

luckily found by coincidence: stefan-niedermann/nextcloud-deck#519
also affected: at least @David-Development and @tobiasKaminsky
for information: @rakekniven

Sync translations from/to Gitlab

For https://gitlab.com/joleaf/nc-passwords-app/-/issues/6

Nextcloud translation to Persian (Farsi)

Hi there!
We have deployed Nextcloud recently and need to localize the interface - which is already done; but incompletely - and want to know how we can include our translations.

Android translation does not work anymore

I re-did the same steps locally and cannot find a mistake.

Do we have any logs?
I would be interested in src/main/res/values/strings.xml

@blizzz maybe?

Add project "checksum" to Transifex sync

• App repo: Add .tx folder including config -> @westberliner
• App repo: Add ignore file -> @westberliner
• App repo: Add l10n folder -> @westberliner
• App repo: Invite "nextcloud bot" with write permissions -> @westberliner
• docker-ci: add repo info to config.json -> rakekniven #332
• Sysadmins of NC: Deploy internally to tx sync process -> @blizzz
• Transifex: New resource should appear -> rakekniven
• Transifex: Do translations and check sync to repo -> rakekniven

How to include specific .txt-file in transifex-bot?

Hey @MorrisJobke,

here another request: I want to add some kind of description about how to use markdown for the Notes app (nextcloud/notes-android#116).

I could store the text in the strings.xml-file and it would be translated by transifex. But i do not really want to do that for clarity reasons. Ideal for me was if i could simply place a plain .md- or .txt-file inside of the android assets-folder (similar to #198).

• Would this kind of file be respected by the transifex-bot yet?
• If not, can you add support for something like this? Or do you have any other idea about how / where to store such a property?

cc @tobiasKaminsky

Create additional project in transifex for talk-ios plurals

Create an additional project in transifex for plurals.
e.g. talk-ios-plurals

Backport translations for apps

We already backport translations to the server properly.
Would be nice to do the same for apps.

@MorrisJobke

Sync for czech language is not working

Today https://help.nextcloud.com/t/missing-strings-in-czech-translation/130459/7 came up.

I checked Transifex for mentioned strings and everything is in place.

A look at https://github.com/nextcloud/server/tree/master/apps/files_sharing/l10n shows that czech language hasn't been updated for 5 years.

Did I miss something?

@blizzz Can you check or forward to someone?

Reporting user is using NC v22.2.3 and therefore it looks like an up-to-date issue.

btw. I checked https://demo1.nextcloud.com/status.php to prove issue and it is at v21.0.4. This is outdated for new users. Where to report it?

Regex issue during transifex string extraction - strings are not extracted

Hello. I am currently checking on the issue nextcloud/cookbook#495. I first thought the problem to be in our code. To narrow down the problem, I manually ran the translation tool with create-pot-files to check the *.pot file generated.

Surprisingly, the .pot file contained the relevant part that was criticized in the named issue. One example would be the strings Fat total and Fat content. Both strings are in our *.vue files (discussable if this is a good idea but not this issue's topic) and are correctly reported in the pot file in fake vue files

#: /tmp/test-vue/cookbook/specialVueFakeDummyForL10nScript.js:73
msgid "Fat content"
msgstr ""

[...]

#: /tmp/test-vue/cookbook/specialVueFakeDummyForL10nScript.js:105
msgid "Fat total"
msgstr ""

In transifex web frontend the Fat content string is showing up just well. The Fat total string is nowhere to find in their page.

After looking into the codes, I assume, the docker container built by Dockerfile-App will do the synchronization with transifex. Unfortunately, I do not find any hint where this docker file is run and where to look for errors/warnings if there are any.

As we are getting daily updates from the translation bot I assume, the docker image is running in general and taking our repository into consideration. So it seems nothing is broken here in first sight.

Can you please help to elaborate the issue further?

Add project "integration_openproject" to Transifex sync

• App repo: Add .tx folder including config -> @eneiluj
• App repo: Add ignore file -> @eneiluj
• App repo: Add l10n folder -> @eneiluj
• App repo: Invite "nextcloud bot" with write permissions -> @eneiluj
• docker-ci: add repo info to config.json -> @eneiluj #347
• Sysadmins of NC: Deploy internally to tx sync process -> @blizzz
• Transifex: New resource should appear -> rakekniven
• Transifex: Do translations and check sync to repo -> rakekniven
• Add resource to help forum page

No data is visible on transifex

I tried to configure the repo according to the documentation here. Yesterday the PR #209 was accepted. The repo is publicly visible, the mail of adding the bot as a collaborator was sent, I do not know if it was already confirmed.

However, I assumed that the project would at least show up in transifex. It might happen that the push to master is not possible but the translations should appear online.
I looked at this page on transifex. I do not find the cookbook app there.

The reason I ask here is that there are a set of translations already in the repo and I want to check if these are automatically imported to transifex or if we need to move them to transifex "somehow". In the latter case, I would ask you for help and advice. But first, we need to get the main connection done.

Thanks anyways

Translation for Geoblocker App

Hello,

I followed the instruction from here to be able to add tanslation for the Geoblocker App for Nextcloud:
Adding Translations

But nothing seems to reach Transifex, so obviously I am missing something or doing something wrong. Any hint where to start looking?

Geoblocker App
Issue

Thanks

Add project "recognize" to Transifex sync

• App repo: Add .tx folder including config -> @marcelklehr
• App repo: Add ignore file -> @marcelklehr
• App repo: Add l10n folder -> @marcelklehr
• App repo: Invite "nextcloud bot" with write permissions -> @marcelklehr
  • Invite pending
• docker-ci: add repo info to config.json -> #388
• Sysadmins of NC: Deploy internally to tx sync process ->
• Transifex: New resource should appear -> @rakekniven
• Transifex: Do translations and check sync to repo -> @rakekniven
• Add resource to wiki -> @rakekniven

Repo URL: https://github.com/nextcloud/recognize

Extract strings from info.xml

Extract name, summary and description from the info XML to properly translate it on transifex.

Should be tackled together with #87.

Translations of long strings vs code styling

Hello,

I have a longer text that needs to be localized. It is a description of an error case and how the user has to solve it.

When thinking of code styling, such a text will likely need to be broken into multiple lines to fit into the code styling requirements. However in the parser of the translationtool (here using the vue parser as an example), the regex seems to parse the combined file only line by line. So most probably it will only catch only the first part of the string for translation.

Do I miss something here? Or is the best way to simply disable the code style checker for the names line and keep everything on one line?

Pick up translation strings from html files

Over at nextcloud/bookmarks#456 I noticed that the translations in our ejs templates, which reside in html files aren't picked up by the translation bot.

Could html be parsed for strings to translate as well?

Update PHP 7.3

Using transifex for Nextcloud related app

Hello

I was told to ask here for help with transifex.

Im currently developing a smartphone app https://github.com/Teifun2/nextcloud-cookbook-flutter for a nextcloud "plugin" https://github.com/nextcloud/cookbook. This nextcloud plugin is already integrated with the nextcloud transifex project. As the smartphone app to this plugin will mostly contain the same "texts" that need translation i was wondering if it is possible to use the same transifex project.

Would it even be possible to use partially the same texts as the cookbook plugin. And what CI and structure would i need to adopt to be accepted into this transifex project?

I hope i am at the correct place to ask these questions here, and if not then please let me know.

Android files app translating fails

Your branch is up to date with 'origin/master'.
+ cp app/src/main/res/values/strings.xml stable-values/master.xml
+ git checkout stable-3.18
Branch 'stable-3.18' set up to track remote branch 'stable-3.18' from 'origin'.
Switched to a new branch 'stable-3.18'
+ cp app/src/main/res/values/strings.xml stable-values/stable-3.18.xml
cp: can't stat 'app/src/main/res/values/strings.xml': No such file or directory

Either it needs a version switch or you need to remove stable-3.18

Originally posted by @nickvergessen in #364 (comment)

Translation ignore list behaves unexpected

• All ignore lists work with * but the .l10nignore nextcloud/activity#888
• Even worse: it is a bit random which exclude list is being used. Since the ignore list is decided in the header https://github.com/nextcloud/docker-ci/blob/master/translations/translationtool/src/translationtool.php#L34-L56 before any branch is checked out, the exclude list for all branches is the same instead the one of the branch. nextcloud/activity#888

l10n bot appears to ignore a particularly long string?

As seen in nextcloud/bookmarks#621, the string defined here appears not to get picked up by the bot.

Support fastlane

Dear @MorrisJobke,

is it possible to add support for fastlane?

If you don't know it, it's basically like a folder/file-structure convention to store simple .txt-files containing descriptions, release notes and some other details for android apps (+ some image files which do not matter in the scope of this issue of course).

You can find a sample structure in the repository for Nextcloud Notes for android.

It would be a very great benefit if those files could be handeled by the transifex-bot because

• F-Droid uses those files for all available information
• Fastlane can be used to deploy to Play Store automatically

This would greatly enhance the accessability for users of other languages than english 🙂.

Thanks

cc @tobiasKaminsky

l10n: Add mjs to list of javascript filename extensions

App gestion started to use javascript files with extension "mjs".

mjs is a extension for module files.

Docs:

• https://v8.dev/features/modules#mjs
• https://v8.dev/features/modules#mjs

See baimard/gestion#146 as issue reference.

Add project "files_libreoffice_edit" to Transifex sync

• Transifex: New resource should appear -> @rakekniven
• Transifex: Do translations and check sync to repo -> @rakekniven
• Add resource to wiki -> @rakekniven

Repo URL: https://github.com/allotropia/nextcloud_files_libreoffice_edit

Add project "salattime" to Transifex sync

• App repo: Add .tx folder including config -> @medismail
• App repo: Add ignore file -> @medismail
• App repo: Add l10n folder -> @medismail
• App repo: Invite "nextcloud bot" with write permissions -> @medismail
  • Invite pending
• docker-ci: add repo info to config.json -> #398
• Sysadmins of NC: Deploy internally to tx sync process ->
• Transifex: New resource should appear -> @rakekniven
• Transifex: Do translations and check sync to repo -> @rakekniven
• Add resource to wiki -> @rakekniven

Repo URL: https://github.com/medismail/salattime

Update ImageMagick in CI environment to support HEIF/HEIC test cases

Steps to reproduce

1. Submit a pullrequest like nextcloud/server#10526 which requires a recent version of ImageMagick convert tool
2. CI test case fails: https://drone.nextcloud.com/nextcloud/server/9604

Expected behaviour

Test case should report green.

Actual behaviour

Due to the version of ImageMagick which lacks support to read HEIF/HEIC files (the new Apple file format for iPhones) in the CI environment, the test case fails (see log below).

Server configuration

Running the tests on macOS with ImageMagick 7.0.8-9 installed through Homebrew works:
brew install --with-libheif imagemagick

Operating system:
macOS 10.13.6

Web server:
embedded php webserver

Database:
embedded sqlite

PHP version:
7.2

Nextcloud version: (see Nextcloud admin page)
github master checkout

Updated from an older Nextcloud/ownCloud or fresh install:
new install

Where did you install Nextcloud from:
github

Logs

CI log (data/nextcloud.log)

Nextcloud CI log (https://drone.nextcloud.com/nextcloud/server/9604)

1) Test\Preview\HEICTest::testGetThumbnail with data set #0 (-85, -61)
Failed asserting that false is not equal to false.

/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:141
/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:103

2) Test\Preview\HEICTest::testGetThumbnail with data set #1 (34, 26)
Failed asserting that false is not equal to false.

/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:141
/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:103

3) Test\Preview\HEICTest::testGetThumbnail with data set #2 (-76, 55)
Failed asserting that false is not equal to false.

/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:141
/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:103

4) Test\Preview\HEICTest::testGetThumbnail with data set #3 (75, -84)
Failed asserting that false is not equal to false.

/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:141
/drone/src/github.com/nextcloud/server/tests/lib/Preview/Provider.php:103

Migration to Vue.js causes trouble with transifex

Hello,

the app cookbook just migrated to Vue.js. Unfortunately, the translation system got broken by it. Almost all translation files were dropped by the bot.

I assume, that the bot did not correctly detect the Vue sources and thus removed non-required entries from the l10n files. Of course, we do not want to lose all the translations yet done. So I am coming to you to ask for advice.

If I just take an example file and throw it into a preg matcher against your detection code, it seems that the file would be selected for translation.
Unfortunately, I cannot look into the dummy vue file generated. Is there a better way than to hack on the generate pot file and keep the dummy file for inspection?

Thank you very much!

Add project "Transfer" to Transifex sync

• App repo: Add .tx folder including config -> @danth
• App repo: Add ignore file -> @danth
• App repo: Add l10n folder -> @danth
• App repo: Invite "nextcloud bot" with write permissions -> @danth
• docker-ci: add repo info to config.json -> danth #370
• Sysadmins of NC: Deploy internally to tx sync process -> @blizzz
• Transifex: New resource should appear -> rakekniven
• Transifex: Do translations and check sync to repo -> rakekniven

Add project "backup" to Transifex sync

• App repo: Add .tx folder including config -> @ArtificialOwl
• App repo: Add ignore file -> @rakekniven nextcloud/backup#66
• App repo: Add l10n folder -> @ArtificialOwl
• App repo: Invite "nextcloud bot" with write permissions -> @ArtificialOwl
• docker-ci: add repo info to config.json -> rakekniven Details: #327
• Sysadmins of NC: Deploy internally to tx sync process -> @blizzz
• Transifex: New resource should appear -> rakekniven
• Transifex: Do translations and check sync to repo -> rakekniven

Add richdocumentscode for translation

PR for initial i18n/l10n work on the richdocumentscode side: CollaboraOnline/richdocumentscode#29
PR for the CI side: #226

Followed instructions here: https://docs.nextcloud.com/server/latest/developer_manual/app/view/l10n.html

By looking at the instructions and the config.json here, it seemed like the app is assumed to be on the root dir of the repo, but we have it under a subdir (nextcloud-app). So we will also add some bits to our build script to copy the l10n directory into the build directory later.

I hope I got everything right for the l10n. Your cooperation/help is much appreciated. Thank you! :)

Translations: Allow apps to specify backport branches

For apps that don't follow the server versions with their stable branches, translations are never updated on those.

Ideally apps should be able to specify a list of stable branches in their config which gets added to https://github.com/nextcloud/docker-ci/blob/master/translations/handleAppTranslations.sh#L68 and https://github.com/nextcloud/docker-ci/blob/master/translations/handleAppTranslations.sh#L16

7.3 integration and acceptance test images

Ignore compiled js in a useful way

See https://www.transifex.com/nextcloud/nextcloud/translate/#es/notifications/150036672

Would need something similar to:
ea5ff0b

But I guess instead of creating a huge list in our docker-ci, it would make sense to allow the apps to specify the list themselves.

translationtool does not catch L10n text from .vue files

for example in https://github.com/rullzer/twofactor_email/blob/55d07312d30fdd828ba8c443b21cef0abb982ec7/src/components/GatewaySettings.vue#L12

<L10n text="You are not using Email as a two-factor authentication method at the moment." />

It does not seem the regex in https://github.com/nextcloud/docker-ci/blob/master/translations/translationtool/src/translationtool.php#L319 catches those texts

Make the android image smaller

A lot of disk space issues are there because most of the space is occupied by the ~9GB android image.

We should try to make this smaller to fit everything on Ramdisks - otherwise I need to disable Ramdisk completely.

cc @AndyScherzinger

Nextcloud Bot pending invite

I added the translation configuration for my project fractava/biblio to this repository in #297.
I have also sent a collaborator invite to the Nextcloud Bot on Github, but so far the invite is not accepted and no commits by the bot have been pushed.

Is there anything else I need to do or do I just have to wait?

Add project "analytics" to Transifex sync

• App repo: Add .tx folder including config -> @Rello Rello/analytics#202
• App repo: Add ignore file -> @Rello Rello/analytics#202
• App repo: Add l10n folder -> @Rello Rello/analytics#202
• App repo: Invite "nextcloud bot" with write permissions -> @Rello
• docker-ci: add repo info to config.json -> rakekniven Details: #324
• Sysadmins of NC: Deploy internally to tx sync process -> @blizzz
• Transifex: New resource should appear -> rakekniven
• Transifex: Do translations and check sync to repo -> rakekniven

Add PHP 7.1 docker

Ref #11

Add file extension "mjs" to list of translatable files

The PR has been merged. But the strings from MJS files are still missing.
As there is no issue for this I am kindly asking for help to solve this.

Originally posted by @rakekniven in #355 (comment)

ghcr.io are not found for "special" dockers

For Android e.g translations-plain is needed.
Which is configured on hub.docker.com like:

Type: Tag
Source: /translations-plain-.*/
Dockerfile location: /translations/Dockerfile-Plain

Can we have such a workflow? @LukasReschke