r0wi/elasticsearch-nextcloud-docker

A docker container hosting elasticsearch with ingest-attachment plugin enabled (compatible with NC fulltext search)

Hi there, it's Robin 👋

👷 Check out what I'm currently working on

• nextcloud/server - ☁️ Nextcloud server, a safe home for all your data (3 weeks ago)
• forcedotcom/dataloader - Salesforce Data Loader (1 month ago)
• nextcloud/files_photospheres - Nextcloud app for viewing Google PhotoSphere 360° images (panorama-images) (2 months ago)
• R0Wi/DHBW-Git-Workshop - (2 months ago)
• R0Wi-DEV/workflow_ocr - This is a Nextcloud Workflow App which enables you to process files via OCR on serverside. (3 months ago)
• nextcloud/logreader - 📜 Log reader for Nextcloud (8 months ago)
• R0Wi/elasticsearch-nextcloud-docker - A docker container hosting elasticsearch with ingest-attachment plugin enabled (compatible with NC fulltext search) (9 months ago)
• nextcloud/richdocuments - 📑 Collabora Online for Nextcloud (9 months ago)
• nextcloud/documentation - 📘 Nextcloud documentation (10 months ago)
• nextcloud/fulltextsearch_elasticsearch - 🔍 Use Elasticsearch to index the content of your Nextcloud (11 months ago)

🌱 My latest projects

• R0Wi/DHBW-Git-Workshop -
• R0Wi/ardour-build - Build instructions and helpers to build the famous DAW Ardour
• R0Wi/R0Wi.github.io - Source for https://r0wi.github.io
• R0Wi/nextcloud-docker-extended - A docker image based on the official Nextcloud image with additional tools and dependencies
• R0Wi/Arduino-Midi-Taptempo -
• R0Wi/BitbucketCoverageApiClient -
• R0Wi/Extensions - Extensions to the basic functionality of various libraries.
• R0Wi/elasticsearch-nextcloud-docker - A docker container hosting elasticsearch with ingest-attachment plugin enabled (compatible with NC fulltext search)
• R0Wi/latex-docker - Docker container for building latex documents
• R0Wi/docker-backup -

🔭 Latest releases I've contributed to

• nextcloud/server (v30.0.0beta5, 3 days ago) - ☁️ Nextcloud server, a safe home for all your data
• nextcloud/richdocuments (v8.4.4, 1 week ago) - 📑 Collabora Online for Nextcloud
• forcedotcom/dataloader (v62.0.0, 1 week ago) - Salesforce Data Loader
• nextcloud/files_photospheres (v1.29.1, 2 months ago) - Nextcloud app for viewing Google PhotoSphere 360° images (panorama-images)
• R0Wi-DEV/workflow_ocr (v1.28.1, 2 months ago) - This is a Nextcloud Workflow App which enables you to process files via OCR on serverside.
• R0Wi/elasticsearch-nextcloud-docker (8.8.2, 9 months ago) - A docker container hosting elasticsearch with ingest-attachment plugin enabled (compatible with NC fulltext search)
• nextcloud/fulltextsearch (23.0.0, 2 years ago) - 🔍 Core of the full-text search framework for Nextcloud
• nextcloud/fulltextsearch_elasticsearch (23.0.0, 2 years ago) - 🔍 Use Elasticsearch to index the content of your Nextcloud
• nextcloud/logreader (v22.0.0, 3 years ago) - 📜 Log reader for Nextcloud

🔨 My recent Pull Requests

• Fix #1189 on forcedotcom/dataloader (1 month ago)
• Increase PHP memory limit for DevContainer to 512mb on nextcloud/server (1 month ago)
• Prepare for NC30 on nextcloud/files_photospheres (2 months ago)
• Fix node build for NC 29 on nextcloud/files_photospheres (2 months ago)
• Make sure show image actionhandler is only called once on nextcloud/files_photospheres (2 months ago)
• Fix Node build on nextcloud/files_photospheres (2 months ago)
• Add support for PHP8.3 in NC28 version on nextcloud/files_photospheres (2 months ago)
• Add PHP8.3 support to NC28 version on R0Wi-DEV/workflow_ocr (2 months ago)
• NC29 compat final on nextcloud/files_photospheres (3 months ago)
• Update devcontainer PHP dependencies to 8.3 on nextcloud/server (3 months ago)

⭐ Recent Stars

• openhab/openhab-addons - Add-ons for openHAB (4 months ago)
• Koenkk/zigbee2mqtt - Zigbee 🐝 to MQTT bridge 🌉, get rid of your proprietary Zigbee bridges 🔨 (7 months ago)
• cars10/elasticvue - Elasticsearch gui for the browser (11 months ago)
• forcedotcom/SFDX-Data-Move-Utility - SFDMU is a cutting-edge Salesforce data migration tool for seamless org population from other orgs or CSV files. It handles all CRUD operations on multiple related objects in one go. (1 year ago)
• devcontainers/cli - A reference implementation for the specification that can create and configure a dev container from a devcontainer.json. (1 year ago)
• mistic100/Photo-Sphere-Viewer - A JavaScript library to display 360° sphere panoramas. (1 year ago)
• UnnoTed/wireguird - wireguard gtk gui for linux (1 year ago)
• raulgomis/semversioner - The easiest way to manage semantic versioning in your project and generate CHANGELOG.md file automatically. (1 year ago)
• emuell/restic-browser - A GUI to browse and restore restic backup repositories. (1 year ago)
• probot/stale - A GitHub App built with Probot that closes abandoned Issues and Pull Requests after a period of inactivity. (1 year ago)

📫 How to reach me

[email protected] https://labella-band.de

Want your own self-generating profile page? Check out readme-scribe!

elasticsearch-nextcloud-docker's Issues

How to migrate to ES docker service?

Hi! Would you please consult the process of migrating data from the elasticsearch which is installed directly on the server to the docker service without loss? Please, give steps and caveats which may exist on this way. Personally me, I wasn't luck with just running fulltextsearch:index command, which gave partial result after completion.

Update to Elasticsearch 8.8.2

Hello,

The Fulltextsearch:elasticsearch is now referencing Elasticsearch 8.8.2.

Can I just change the tag to 8.8.2?

If not, can you update to use that version?

Thanks

Docker run command, please

Hi! Please, add to the manual how to start the container with the docker run command. Thanks!

"failed to obtain node locks" error

It looks like the permissions for a secure elasticsearch container don't bootstrap properly any more.

If you get error "failed to obtain node locks" in the logs, then you may need to set the volume to the following permissions:

1. set a local volume:

    volumes:
      - ./elasticsearch_data:/usr/share/elasticsearch/data

Create the storage dir and change permissions

mkdir elasticsearch_data
chown -R 1000:0 ./elasticsearch_data/

The container will then start without error

note that this applies to the official elasticsearch image too
note this is using image tag 8.6.1

Add log facility

Hi! Please, add to your description the following options to the docker file:

-v /app/elasticsearch/log:/usr/share/elasticsearch/logs
-v /app/elasticsearch/data:/usr/share/elasticsearch/data

What I've got that the directories logs and data should have 775 mask.

Again about reindexing

Hi! I am asking for help. Almost a week after moving from server installed elasticsearch to the dockerised I am struggling to make the full text search working on my instance:

• NC 26.0.3 (bare metal)
• All fulltextsearch apps are update
• Using groufolders app
• Elasticsearch via dockerised container: 8.6.1

Reindexing done with the following commands:

$ sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:stop
$ curl -X DELETE localhost:9200/my-index
$ sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:reset
$ sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:index

Searching with curl in index "my-index" for the word "Ivanova" (our member) gives (user data are stripped and scratched):

$ curl -X GET "localhost:9200/my-index/_search?pretty" -H 'Content-Type: application/json' -d'
{
  "query": {
    "match": {
      "title": "Ivanova"
    }
  }
}
'
{
  "took" : 4,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 6,
      "relation" : "eq"
    },
    "max_score" : 9.4341955,
    "hits" : [
      {
        "_index" : "my-index",
        "_id" : "files:6811",
        "_score" : 9.4341955,
        "_ignored" : [
          "content.keyword"
        ],
        "_source" : {
          "owner" : "user1",
          "groups" : [
            "GroupA",
            "GroupB",
            "GroupC",
            "GroupD"
          ],
          "circles" : [ ],
          "metatags" : [
            "files_group_folders"
          ],
          "source" : "files_group_folders",
          "title" : "GroupA/Scanned/Ivanova.pdf",
          "users" : [ ],
          "content" : "Ivanova document"
		  "tags" : [ ],
          "attachment" : {
            "date" : "2022-04-06T06:29:11Z",
            "content_type" : "application/pdf",
            "format" : "application/pdf; version=\"A-2b\"",
            "modified" : "2022-04-06T06:29:11Z",
            "language" : "uk",
            "creator_tool" : "ABBYY FineReader 14",
            "content_length" : 1612
          },
          "provider" : "files",
          "subtags" : [ ],
          "parts" : {
            "comments" : ""
          },
          "links" : [ ],
          "share_names" : {
            "user0" : "GroupA/Scanned/Ivanov.pdf",
            "user1" : "Scanned/Ivanov.pdf",
            "user2" : "GroupA/Scanned/Ivanov.pdf",
            "user3" : "",
          },
          "hash" : "aeca335860b2f59954q5e7fd34b174a1"
        }
      },
      {
        "_index" : "my-index",
        "_id" : "files:6812",
        "_score" : 9.4341955,
        "_ignored" : [
          "content.keyword"
        ],
        "_source" : {
          "owner" : "user0",
          "groups" : [
            "GroupA",
            "GroupB",
            "GroupC",
            "GroupD"
          ],
          "circles" : [ ],
          "metatags" : [
            "files_group_folders"
          ],
          "source" : "files_group_folders",
          "title" : "GroupA/Scanned/Ivanova2.pdf",
          "users" : [ ],
          "content" : "Ivanova........................................................... ...................",
          "tags" : [ ],
          "attachment" : {
            "date" : "2022-04-01T08:00:50Z",
            "content_type" : "application/pdf",
            "format" : "application/pdf; version=\"A-2b\"",
            "modified" : "2022-04-01T08:00:50Z",
            "language" : "uk",
            "creator_tool" : "ABBYY FineReader 14",
            "content_length" : 1260
          },
          "provider" : "files",
          "subtags" : [ ],
          "parts" : {
            "comments" : ""
          },
          "links" : [ ],
          "share_names" : {
            "user0" : "GroupA/Scanned/Ivanova2.pdf",
            "user1" : "Scanned/Ivanova2.pdf",
            "user2" : "GroupA/Scanned/Ivanova2.pdf",
            "user3" : "",
          },
          "hash" : "e09e889376ebe62b907b8023f37d21a9"
        }
      },
      {
        "_index" : "my-index",
        "_id" : "files:1576",
        "_score" : 9.30954,
        "_source" : {
          "owner" : "user0",
          "groups" : [
            "GroupA",
            "GroupB",
            "GroupC",
            "GroupD"
          ],
          "circles" : [ ],
          "metatags" : [
            "files_group_folders"
          ],
          "source" : "files_group_folders",
          "title" : "GroupA/Scanned/Ivaniva CV.pdf",
          "users" : [ ],
          "content" : "",
          "tags" : [ ],
          "attachment" : {
            "date" : "2022-06-02T07:57:28Z",
            "keywords" : "Scanned image",
            "content_type" : "application/pdf",
            "author" : "NAPS2",
            "format" : "application/pdf; version=1.4",
            "modified" : "2022-06-02T07:57:28Z",
            "language" : "lt",
            "title" : "Scanned image",
            "creator_tool" : "NAPS2",
            "content_length" : 4
          },
          "provider" : "files",
          "subtags" : [ ],
          "parts" : {
            "comments" : ""
          },
          "links" : [ ],
          "share_names" : {
            "user0" : "GroupA/Scanned/Ivanova CV.pdf",
            "user5" : "GroupA/Scanned/Ivanova CV.pdf",
            "user3" : ""
          },
          "hash" : "53f4a218a7ac0f31648efc0834c35199"
        }
      },
      {
        "_index" : "my-index",
        "_id" : "files:518673",
        "_score" : 8.218001,
        "_ignored" : [
          "content.keyword"
        ],
        "_source" : {
          "owner" : "user0",
          "groups" : [
            "GroupD"
          ],
          "circles" : [ ],
          "metatags" : [
            "files_group_folders"
          ],
          "source" : "files_group_folders",
          "title" : "GroupA/Scanned/Ivanova Bulletin.docx",
          "users" : [
            "user8"
          ],
          "content" : "Ivanova Bulletin text text",
          "tags" : [ ],
          "attachment" : {
            "date" : "2023-06-13T09:19:00Z",
            "content_type" : "application/vnd.openxmlformats-officedocument.wordprocessingml.document",
            "author" : "Administrator",
            "modifier" : "User6",
            "modified" : "2023-06-14T13:32:00Z",
            "language" : "uk",
            "content_length" : 1701,
            "print_date" : "2023-06-14T13:30:00Z"
          },
          "provider" : "files",
          "subtags" : [ ],
          "parts" : {
            "comments" : ""
          },
          "links" : [ ],
          "share_names" : {
            "user0" : "GroupA/Bulls/Ivanova Bull.docx",
            "user9" : "GroupA/Bulls/Ivanova Bull.docx"
          },
          "hash" : "99a498dbb1db6f68a6be3793e30a9476"
        }
      },
      {
        "_index" : "my-index",
        "_id" : "files:6806",
        "_score" : 7.622202,
        "_source" : {
          "share_names" : {
            "user0" : "GroupA/Scanned/Photos/Ivanova",
            "user2" : "Scanned/Photos/Ivanova",
            "user3" : ""
          },
          "owner" : "user0",
          "users" : [ ],
          "groups" : [
            "GroupA",
            "GroupB",
            "GroupC",
            "GroupD"
          ],
          "circles" : [ ],
          "links" : [ ],
          "metatags" : [
            "files_group_folders"
          ],
          "subtags" : [ ],
          "tags" : [ ],
          "hash" : "",
          "provider" : "files",
          "source" : "files_group_folders",
          "title" : "GroupA/Scanned/Ivanova",
          "parts" : [ ],
          "content" : ""
        }
      },
      {
        "_index" : "my-index",
        "_id" : "files:466569",
        "_score" : 5.747198,
        "_ignored" : [
          "content.keyword"
        ],
        "_source" : {
          "owner" : "user0",
          "groups" : [
            "GroupD"
          ],
          "circles" : [ ],
          "metatags" : [
            "files_group_folders"
          ],
          "source" : "files_group_folders",
          "title" : "GroupA/Applications/Ivanova.docx",
          "users" : [
            "user4",
            "user5",
            "user6",
            "user7"
          ],
          "content" : "Application of Ivanova text text text",
          "tags" : [ ],
          "attachment" : {
            "date" : "2023-03-10T12:25:00Z",
            "content_type" : "application/vnd.openxmlformats-officedocument.wordprocessingml.document",
            "author" : "user5",
            "modifier" : "user10",
            "modified" : "2023-05-17T17:55:09Z",
            "language" : "uk",
            "content_length" : 1550
          },
          "provider" : "files",
          "subtags" : [ ],
          "parts" : {
            "comments" : ""
          },
          "links" : [ ],
          "share_names" : {
            "user0" : "GroupA/Applications/Ivanova.docx",
            "user6" : "GroupA/Applications/Ivanova.docx",
            "user3" : "",
          },
          "hash" : "f8c12747f9b240ed696385d2aff7f0fe"
        }
      }
    ]
  }
}

Next, I search for Ivanova on behind of a user0

$ sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:search user0 Ivanova
search
> Files
 - 518673 score:0
 - 480179 score:0
 - 514585 score:0
 - 527182 score:0
 - 531276 score:0
 - 363692 score:0

The documents are stored in the groupfolder, which is accessible to user0, user1, user2, user3, user10, but that's what I see when searching with the help of NC fulltextsearch app:

$ sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:search user10 Ivanova
search
> Files

$ sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:search user3 Ivanova
search
> Files
 - 97091 score:0

Obviously, users in webUI cannot see the proper output.

Would you be so kind to explain, why it is not working as expected? What should I do to make it working? Thanks!

No results in WebUI or android app

Hello!

I recently upgraded elastic search from 7.17.7 which was working fine until recently. I saw that 8.X.X was now supported so I upgrade.

I have nextcloud installed via docker using the official image and have tried different elastic search images but none of them work in the WebUI or the Android app. I have everything setup and it tests ok. I used the reset command and deleted the old data folder.
Initial index runs and completes with no errors. Then i can search from the command line for text in a document and it gives me the correct results. When i add a new file it is indexed and is working from the command line.

I use portainer and copied the docker compose.yml and tried it with and without authentication.

Container logs:

loaded module [parent-join] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [percolator] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [rank-eval] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [reindex] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [repositories-metering-api] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [repository-azure] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [repository-encrypted] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [repository-gcs] | @timestamp=2023-08-27T14:34:23.611Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [repository-s3] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [repository-url] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [runtime-fields-common] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [search-business-rules] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [searchable-snapshots] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [snapshot-based-recoveries] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [snapshot-repo-test-kit] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [spatial] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [transform] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [transport-netty4] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [unsigned-long] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [vector-tile] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [wildcard] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-aggregate-metric] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-analytics] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-async] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-async-search] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-autoscaling] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-ccr] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-core] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-deprecation] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-enrich] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-eql] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-fleet] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-graph] | @timestamp=2023-08-27T14:34:23.612Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-identity-provider] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-ilm] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-logstash] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-ml] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-monitoring] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-ql] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-rollup] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-security] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-shutdown] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-sql] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-stack] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-text-structure] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-voting-only-node] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-watcher] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
loaded module [x-pack-write-load-forecaster] | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
no plugins loaded | @timestamp=2023-08-27T14:34:23.613Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.plugins.PluginsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/ubuntu--vg-ubuntu--lv)]], net usable_space [335.7gb], net total_space [454.8gb], types [ext4] | @timestamp=2023-08-27T14:34:24.424Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.env.NodeEnvironment elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
heap size [512mb], compressed ordinary object pointers [true] | @timestamp=2023-08-27T14:34:24.424Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.env.NodeEnvironment elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
node name [d7fbf7ca712d], node ID [K59IcvM6SSqnvCfGk_CMfQ], cluster name [docker-cluster], roles [ingest, data_frozen, ml, data_hot, transform, data_content, data_warm, master, remote_cluster_client, data, data_cold] | @timestamp=2023-08-27T14:34:24.445Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.node.Node elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
Security is enabled | @timestamp=2023-08-27T14:34:25.315Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.xpack.security.Security elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml] | @timestamp=2023-08-27T14:34:25.453Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.xpack.security.authz.store.FileRolesStore elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=512mb}] | @timestamp=2023-08-27T14:34:25.723Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.transport.netty4.NettyAllocator elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b] | @timestamp=2023-08-27T14:34:25.732Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.indices.recovery.RecoverySettings elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
using discovery type [single-node] and seed hosts providers [settings] | @timestamp=2023-08-27T14:34:25.745Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.discovery.DiscoveryModule elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
initialized | @timestamp=2023-08-27T14:34:26.236Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.node.Node elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
starting ... | @timestamp=2023-08-27T14:34:26.237Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.node.Node elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
persistent cache index loaded | @timestamp=2023-08-27T14:34:26.248Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.xpack.searchablesnapshots.cache.full.PersistentCache elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
deprecation component started | @timestamp=2023-08-27T14:34:26.248Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.xpack.deprecation.logging.DeprecationIndexingComponent elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
publish_address {172.20.0.2:9300}, bound_addresses {0.0.0.0:9300} | @timestamp=2023-08-27T14:34:26.324Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.transport.TransportService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144] | @timestamp=2023-08-27T14:34:26.525Z log.level=WARN ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.bootstrap.BootstrapChecks elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
Transport SSL must be enabled if security is enabled. Please set [xpack.security.transport.ssl.enabled] to [true] or disable security by setting [xpack.security.enabled] to [false] | @timestamp=2023-08-27T14:34:26.526Z log.level=WARN ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.bootstrap.BootstrapChecks elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
this node is locked into cluster UUID [umQBcy2-QMaq6qMias63MQ] but [cluster.initial_master_nodes] is set to [d7fbf7ca712d]; remove this setting to avoid possible data loss caused by subsequent cluster bootstrap attempts | @timestamp=2023-08-27T14:34:26.526Z log.level=WARN ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.cluster.coordination.ClusterBootstrapService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
elected-as-master ([1] nodes joined)[FINISH_ELECTION, {d7fbf7ca712d}{K59IcvM6SSqnvCfGk_CMfQ}{o8UE6zAEQ4yrRUyEunitTw}{d7fbf7ca712d}{172.20.0.2}{172.20.0.2:9300}{cdfhilmrstw} completing election], term: 6, version: 141, delta: master node changed {previous [], current [{d7fbf7ca712d}{K59IcvM6SSqnvCfGk_CMfQ}{o8UE6zAEQ4yrRUyEunitTw}{d7fbf7ca712d}{172.20.0.2}{172.20.0.2:9300}{cdfhilmrstw}]} | @timestamp=2023-08-27T14:34:26.577Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][masterService#updateTask][T#1] log.logger=org.elasticsearch.cluster.service.MasterService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
master node changed {previous [], current [{d7fbf7ca712d}{K59IcvM6SSqnvCfGk_CMfQ}{o8UE6zAEQ4yrRUyEunitTw}{d7fbf7ca712d}{172.20.0.2}{172.20.0.2:9300}{cdfhilmrstw}]}, term: 6, version: 141, reason: Publication{term=6, version=141} | @timestamp=2023-08-27T14:34:26.601Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.cluster.service.ClusterApplierService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
starting file settings watcher ... | @timestamp=2023-08-27T14:34:26.630Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.reservedstate.service.FileSettingsService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
failed to notify ClusterStateListener | @timestamp=2023-08-27T14:34:28.142Z log.level=WARN ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.cluster.service.ClusterApplierService elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster error.type=java.lang.IllegalStateException error.message=unable to launch a new watch service error.stack_trace=java.lang.IllegalStateException: unable to launch a new watch service
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.startWatcher(FileSettingsService.java:255)
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.startIfMaster(FileSettingsService.java:151)
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.clusterChanged(FileSettingsService.java:146)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateListener(ClusterApplierService.java:558)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateListeners(ClusterApplierService.java:544)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:504)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:428)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:154)
at [email protected]/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:850)
at [email protected]/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:257)
at [email protected]/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:223)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.io.IOException: User limit of inotify watches reached
at java.base/sun.nio.fs.LinuxWatchService$Poller.implRegister(LinuxWatchService.java:264)
at java.base/sun.nio.fs.AbstractPoller.processRequests(AbstractPoller.java:266)
at java.base/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:364)
... 1 more
publish_address {172.20.0.2:9200}, bound_addresses {0.0.0.0:9200} | @timestamp=2023-08-27T14:34:28.145Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.http.AbstractHttpServerTransport elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
started {d7fbf7ca712d}{K59IcvM6SSqnvCfGk_CMfQ}{o8UE6zAEQ4yrRUyEunitTw}{d7fbf7ca712d}{172.20.0.2}{172.20.0.2:9300}{cdfhilmrstw}{xpack.installed=true} | @timestamp=2023-08-27T14:34:28.146Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=main log.logger=org.elasticsearch.node.Node elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
The default [remove_binary] value of 'false' is deprecated and will be set to 'true' in a future release. Set [remove_binary] explicitly to 'true' or 'false' to ensure no behavior change. | @timestamp=2023-08-27T14:34:28.165Z log.level=WARN data_stream.dataset=deprecation.elasticsearch data_stream.namespace=default data_stream.type=logs elasticsearch.event.category=parsing event.code=attachment-remove-binary ecs.version=1.2.0 service.name=ES_ECS event.dataset=deprecation.elasticsearch process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.deprecation.ingest.attachment.AttachmentProcessor elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
license [fdd9d593-df7a-4a8b-82e8-f070e1ade2b0] mode [basic] - valid | @timestamp=2023-08-27T14:34:28.175Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.license.LicenseService elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
license mode is [basic], currently licensed security realms are [reserved/reserved,file/default_file,native/default_native] | @timestamp=2023-08-27T14:34:28.176Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.xpack.security.authc.Realms elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
starting file settings watcher ... | @timestamp=2023-08-27T14:34:28.176Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.reservedstate.service.FileSettingsService elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
failed to notify ClusterStateListener | @timestamp=2023-08-27T14:34:29.696Z log.level=WARN ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.cluster.service.ClusterApplierService elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster error.type=java.lang.IllegalStateException error.message=unable to launch a new watch service error.stack_trace=java.lang.IllegalStateException: unable to launch a new watch service
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.startWatcher(FileSettingsService.java:255)
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.startIfMaster(FileSettingsService.java:151)
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.clusterChanged(FileSettingsService.java:146)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateListener(ClusterApplierService.java:558)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateListeners(ClusterApplierService.java:544)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:504)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:428)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:154)
at [email protected]/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:850)
at [email protected]/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:257)
at [email protected]/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:223)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.io.IOException: User limit of inotify watches reached
at java.base/sun.nio.fs.LinuxWatchService$Poller.implRegister(LinuxWatchService.java:264)
at java.base/sun.nio.fs.AbstractPoller.processRequests(AbstractPoller.java:266)
at java.base/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:364)
... 1 more
recovered [4] indices into cluster_state | @timestamp=2023-08-27T14:34:29.697Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][masterService#updateTask][T#1] log.logger=org.elasticsearch.gateway.GatewayService elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
starting file settings watcher ... | @timestamp=2023-08-27T14:34:29.706Z log.level=INFO ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.reservedstate.service.FileSettingsService elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster
failed to notify ClusterStateListener | @timestamp=2023-08-27T14:34:31.227Z log.level=WARN ecs.version=1.2.0 service.name=ES_ECS event.dataset=elasticsearch.server process.thread.name=elasticsearch[d7fbf7ca712d][clusterApplierService#updateTask][T#1] log.logger=org.elasticsearch.cluster.service.ClusterApplierService elasticsearch.cluster.uuid=umQBcy2-QMaq6qMias63MQ elasticsearch.node.id=K59IcvM6SSqnvCfGk_CMfQ elasticsearch.node.name=d7fbf7ca712d elasticsearch.cluster.name=docker-cluster error.type=java.lang.IllegalStateException error.message=unable to launch a new watch service error.stack_trace=java.lang.IllegalStateException: unable to launch a new watch service
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.startWatcher(FileSettingsService.java:255)
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.startIfMaster(FileSettingsService.java:151)
at [email protected]/org.elasticsearch.reservedstate.service.FileSettingsService.clusterChanged(FileSettingsService.java:146)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateListener(ClusterApplierService.java:558)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateListeners(ClusterApplierService.java:544)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:504)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:428)
at [email protected]/org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:154)
at [email protected]/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:850)
at [email protected]/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:257)
at [email protected]/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:223)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.io.IOException: User limit of inotify watches reached
at java.base/sun.nio.fs.LinuxWatchService$Poller.implRegister(LinuxWatchService.java:264)
at java.base/sun.nio.fs.AbstractPoller.processRequests(AbstractPoller.java:266)
at java.base/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:364)
... 1 more

Even with errors in these logs it still works just fine from the command line just not in nextcloud itself. I have also tried rolling back to older versions in nextcloud and older versions of elastic search. When i do that the containers will not start anymore. Any help would be great!

Not working. How to check?

I started the container, trying to check with telnet 127.0.0.1 9200 and constantly getting Connection refused error.
The same about trying with curl -L http://127.0.0.1:9200 and getting Connection reset by peer.
How to check whether the service is working?

UPD: disabled machine learning with xpack.ml.enabled=false and it's started!

Nextcloud doesn't show the results of context search

I have used to use the elasticsearch installed directly on the server. Now I am trying to migrate to the docker. Docker is working fine with the version 7.6.0. I have changed the path to the data directory to /var/lib/elasticsearch in order to use the existing there data.

However, Nextcloud doesn't show in the search result the section for fulltext search.

Please, advise, what to do?