Chapter 3 – Database Easy Install - Failing

[ukncsc]

Chapter 3 – Database Easy Install - Failing

[ehosmer]

Good new, install completed!

luser@orion:/opt/lme/Chapter 3 Files$ sudo docker stack ps lme
ID NAME IMAGE NODE DESIRED STATE CURRENT STATE ERROR PORTS
iuo60zhmws1j lme_logstash.1 docker.elastic.co/logstash/logstash:7.4.0 orion Running Running 5 minutes ago
xkifqr6sh062 lme_kibana.1 docker.elastic.co/kibana/kibana:7.4.0 orion Running Running 5 minutes ago
kx4ivgw8smz3 lme_elasticsearch.1 docker.elastic.co/elasticsearch/elasticsearch:7.4.0 orion Running Running 5 minutes ago
luser@orion:/opt/lme/Chapter 3 Files$

[duncan-ncc]

Hi @Bwshort1
We use the Docker convenience script from get.docker.com
The link you point to on download.docker.com is a file listing, for example the release file mentioned above is located here https://download.docker.com/linux/ubuntu/dists/bionic/Release

It is also possible the script is not using the proxy settings you have defined in the various places.

I would suggest you either allow this server to reach out directly to the sources listed in the docker script temporarily or run the get.docker.com script yourself before installing LME.

[Bwshort1]

Thanks

I will try the 2nd option first.
Good to know that this is an option as im sure the instructions for LME state that docker should not be installed prior. At least I think I read that.

Will keep you posted.

On a side note. I have run through this process on a test network that does not require proxys and it works very well so it must be something to do this this network / proxy that my client is using.

[Bwshort1]

Hello

Update on this issue:
I have got past the repository issue that I was having.
Discovered that in bashrc and apt.conf I had an error in the proxy settings.
Incorrect - ACQUIRE::HTTPS::PROXY "https://172.16.200.125:8080";
Correct - ACQUIRE::HTTPS::PROXY "http://172.16.200.125:8080";

However I am still having issues installing LME.
Once the installer gets past "Installing Docker" it just hangs on "Waiting for elasticsearch to be ready".

Are you able to advise on any ways of getting round this?
What exactly is it looking / waiting for?

Logs below, thanks.

[x] Installing docker

• sh -c apt-get update -qq >/dev/null
• sh -c DEBIAN_FRONTEND=noninteractive apt-get install -y -qq apt-transport-https ca-certificates curl >/dev/null
• sh -c curl -fsSL "https://download.docker.com/linux/ubuntu/gpg" | apt-key add -qq - >/dev/null
  Warning: apt-key output should not be parsed (stdout is not a terminal)
• sh -c echo "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable" > /etc/apt/sources.list.d/docker.list
• sh -c apt-get update -qq >/dev/null
• [ -n ]
• sh -c apt-get install -y -qq --no-install-recommends docker-ce >/dev/null
• sh -c docker version
  [x] Configuring docker swarm
  Swarm initialized: current node (ig6q3lrfebpqr2etzsiyuuear) is now a manager.

To add a worker to this swarm, run the following command:

docker swarm join --token SWMTKN-1-64owbqywflt4lmi0qrgd5yewmymy8e9wpb7eqpp0omr8ygyl4c-can04ywqw45zr7yuda1gl1z9x 172.16.200.104:2377

To add a manager to this swarm, run 'docker swarm join-token manager' and follow the instructions.

[x] Adding certificates and keys to Docker
sxop1wja0u5za8xybgngl3d3n
c07m7ryigo7arb5z179400oxb
pz2juliurbqnn450nv4ljvmba
siirvzxcgva18ktm0bs3tsqxh
yqsdj15rs7jyqjqdna5v2lexv
p7iahmatfv9r1qnw9to8pp2bw
g1hlgy8pvbn28he11y9psgd4o
[x] Updating logstash configuration with logstash writer
yailonqolvzcbur4qegx6tvd3
sg8ctvygz5hxm70gf9pukcn4i
vm.max_map_count = 262144
Creating network lme_esnet
Creating service lme_logstash
Creating service lme_elasticsearch
Creating service lme_kibana
[x] Waiting for elasticsearch to be ready

[duncan-ncc]

Hi @Bwshort1
'Waiting for elasticsearch to be ready' - This is when the script waits for the elasticsearch servers rest API to return that the elasticsearch server is up and ready and available to receive logs. This check uses the curl command to connect to the server on port 9200 locally with the temporary username and password of elastic:temp.

This stage can often take ~30 minute whilst elasticsearch starts up depending on RAM/CPU and disk throughput.

You can manually check this using the following command
curl --cacert /opt/lme/Chapter\ 3\ Files/certs/root-ca.crt --user elastic:temp https://127.0.0.1:9200

[Bwshort1]

Thanks, this is usefull info.

Ran you command and got:
curl: (7) Failed to connect to 127.0.0.1 port 9200: Connection refused

Looks like I may need to put a NO_Proxy for local in the curlrc file as it is currently set to :

proxy = 172.16.200.125:8080

[duncan-ncc]

Hi @Bwshort1
If that curl command doesn't work on your host then its unlikely that the script will work,
It does seem that these issues are centered around the proxy existing.

[Bwshort1]

Still having issues.
Currently the only location that has proxy settings is /etc/environment
Set with:
http_proxy="http://172.16.200.125:8080/"
https_proxy="http://172.16.200.125:8080/"
ftp_proxy="http://172.16.200.125:8080/"
no_proxy="localhost,127.0.0.1,::1,172.16.200.104"
HTTP_PROXY="http://172.16.200.125:8080/"
HTTPS_PROXY="http://172.16.200.125:8080/"
FTP_PROXY="http://172.16.200.125:8080/"
NO_PROXY="localhost,127.0.0.1,::1,172.16.200.104"

All functions pick up these settings apt , curl , apt etc..

However im still getting:
[x] Updating logstash configuration with logstash writer
yailonqolvzcbur4qegx6tvd3
sg8ctvygz5hxm70gf9pukcn4i
vm.max_map_count = 262144
Creating network lme_esnet
Creating service lme_logstash
Creating service lme_elasticsearch
Creating service lme_kibana
[x] Waiting for elasticsearch to be ready

From what I have been reading, when you get curl: (7) Failed to connect to 127.0.0.1 port 9200: Connection refused
This indicated that there is nothing answering / running on the server on that port.
Do you know of any logs I can check to make sure that elasticsearch is installing?

Have you installed this on a network that requires proxy settings?

When I first started this project there was another option to installing step 3, think is was step 3b difficult. Are you able to republish this method?

Thanks

[duncan-ncc]

Hi @Bwshort1

If you run docker service -f logs lme_elasticsearch this will give you the elasticsearch logs as they happen (open a new window to the box at the same time as you are running the script)

you can find the old 3b method here however this is out of date and doesn't take into account the changes we have made since then, Mostly around user authentication.

[ehosmer]

My install also hangs at "[x] Waiting for elasticsearch to be ready" and I have no clue on how to proceed?

UPDATE: The Unix admins noticed a few things that failed during the install
A. Missing folder ./rng
B. OwnerShip of /lme had me change it to user that installed.

Re-running the install script went better but had errors that looked to be related to previous partial install.
Reinstalling OS and will try again.

---

login as: lme
[email protected]'s password:
Welcome to Ubuntu 18.04.3 LTS (GNU/Linux 4.15.0-72-generic x86_64)

• Documentation: https://help.ubuntu.com
• Management: https://landscape.canonical.com
• Support: https://ubuntu.com/advantage

System information as of Tue Dec 10 16:36:35 UTC 2019

System load: 0.0 Processes: 94
Usage of /: 2.4% of 244.58GB Users logged in: 0
Memory usage: 1% IP address for eth0: 192.138.137.18
Swap usage: 0%

49 packages can be updated.
0 updates are security updates.

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

To run a command as administrator (user "root"), use "sudo ".
See "man sudo_root" for details.

lme@orion:$ sudo bash
[sudo] password for lme:
root@orion:# exit
exit
lme@orion:$ sudo bash
[sudo] password for lme:
root@orion:# app update

Command 'app' not found, but there are 15 similar ones.

root@orion:# apt update
Hit:1 http://us.archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://us.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:3 http://us.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:4 http://us.archive.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:5 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [81 7 kB]
Get:6 http://us.archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [28 8 kB]
Get:7 http://us.archive.ubuntu.com/ubuntu bionic-security/main amd64 Packages [5 93 kB]
Get:8 http://us.archive.ubuntu.com/ubuntu bionic-security/main Translation-en [1 94 kB]
Fetched 2,144 kB in 1s (1,723 kB/s)
Reading package lists... Done
Building dependency tree
Reading state information... Done
50 packages can be upgraded. Run 'apt list --upgradable' to see them.
root@orion:# apt install git -y
Reading package lists... Done
Building dependency tree
Reading state information... Done
git is already the newest version (1:2.17.1-1ubuntu0.4).
git set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 50 not upgraded.
root@orion:# git clone https://github.com/ukncsc/lme.git /opt/lme/
Cloning into '/opt/lme'...
remote: Enumerating objects: 146, done.
remote: Counting objects: 100% (146/146), done.
remote: Compressing objects: 100% (97/97), done.
remote: Total 504 (delta 91), reused 95 (delta 49), pack-reused 358
Receiving objects: 100% (504/504), 2.80 MiB | 22.20 MiB/s, done.
Resolving deltas: 100% (272/272), done.
root@orion:# cd /opt/lme/Chapter\ 3\ Files/
root@orion:/opt/lme/Chapter 3 Files# ls
dashboard_update.sh deploy.sh docker-compose-stack.yml lme_update.sh logstash.conf osmap.csv winlogbeat.yml
root@orion:/opt/lme/Chapter 3 Files# ./deploy.sh install
[x] Installing prerequisites
Reading package lists...
Building dependency tree...
Reading state information...
net-tools is already the newest version (1.60+git20161116.90da8a0-1ubuntu1).
net-tools set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 50 not upgraded.
Enter the IP that winlogbeat will use to communicate with this box: 192.138.137.18
Enter the DNS name that winlogbeat uses to communicate with this box: orion.kettering.edu
[x] Configuring winlogbeat config and certificates to use 192.138.137.18 as the IP and orion.kettering.edu as the DNS
This OS was detected as: ubuntu
[x] Configuring Auto Updates
Reading package lists...
Building dependency tree...
Reading state information...
Suggested packages:
bsd-mailx default-mta | mail-transport-agent needrestart
The following packages will be upgraded:
unattended-upgrades
1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.
Need to get 41.7 kB of archives.
After this operation, 24.6 kB of additional disk space will be used.
Get:1 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 unattended-upgrades all 1.1ubuntu1.18.04.13 [41.7 kB]
Fetched 41.7 kB in 0s (188 kB/s)
Preconfiguring packages ...
(Reading database ... 66978 files and directories currently installed.)
Preparing to unpack .../unattended-upgrades_1.1ubuntu1.18.04.13_all.deb ...
Unpacking unattended-upgrades (1.1ubuntu1.18.04.13) over (1.1ubuntu1.18.04.11) ...
Processing triggers for ureadahead (0.100.0-21) ...
Processing triggers for systemd (237-3ubuntu10.29) ...
Setting up unattended-upgrades (1.1ubuntu1.18.04.13) ...
Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
grep: grep: No such file or directory
grep: APT::Periodic::Update-Package-Lists "1";: No such file or directory
grep: grep: No such file or directory
grep: APT::Periodic::Unattended-Upgrade "1";: No such file or directory
grep: grep: No such file or directory
grep: APT::Periodic::Download-Upgradeable-Packages "1";: No such file or directory
This script will use self signed certificates for communication and encryption, Do you want to continue with self signed certificates? ([y]es/[n]o): y
[x] making root CA
Generating RSA private key, 4096 bit long modulus (2 primes)
................++++
.......................++++
e is 65537 (0x010001)
Can't load /home/lme/.rnd into RNG
140586668270016:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/lme/.rnd
[x] Signing root CA
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = Swarm
Getting Private key
[x] Making logstash Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
..........................++++
.................................................................................................................................................................................................................................................................................................................................................................................++++
e is 65537 (0x010001)
Can't load /home/lme/.rnd into RNG
140347234439616:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/lme/.rnd
[x] Signing logstash cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = orion.kettering.edu
Getting CA Private Key
[x] Making wlbclient Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
....................++++
.............................++++
e is 65537 (0x010001)
Can't load /home/lme/.rnd into RNG
139968905277888:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/lme/.rnd
[x] Signing wlbclient cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = wlbclient
Getting CA Private Key
[x] Making logstash Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
.................++++
............................................................................................................................++++
e is 65537 (0x010001)
Can't load /home/lme/.rnd into RNG
140601764524480:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/lme/.rnd
[x] Sign elasticsearch cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = elasticsearch
Getting CA Private Key
[x] Making logstash Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
..........................................++++
.............................++++
e is 65537 (0x010001)
Can't load /home/lme/.rnd into RNG
140249027957184:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/lme/.rnd
[x] Sign kibana cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = kibana
Getting CA Private Key
[x] Installing curl to get the docker convenience script
Reading package lists...
Building dependency tree...
Reading state information...
curl is already the newest version (7.58.0-2ubuntu3.8).
curl set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.
[x] Installing docker

• sh -c apt-get update -qq >/dev/null
• sh -c DEBIAN_FRONTEND=noninteractive apt-get install -y -qq apt-transport-https ca-certificates curl >/dev/null
• sh -c curl -fsSL "https://download.docker.com/linux/ubuntu/gpg" | apt-key add -qq - >/dev/null
  Warning: apt-key output should not be parsed (stdout is not a terminal)
• sh -c echo "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable" > /etc/apt/sources.list.d/docker.list
• sh -c apt-get update -qq >/dev/null
• [ -n ]
• sh -c apt-get install -y -qq --no-install-recommends docker-ce >/dev/null
• sh -c docker version
  [x] Configuring docker swarm
  Swarm initialized: current node (kha0lzvjq1lpg8xbkopwzrsce) is now a manager.

To add a worker to this swarm, run the following command:

docker swarm join --token SWMTKN-1-4jtxb7yy7moo6mptiw4o51ckclzdcb8vbqin45evgi4q7fva0z-cblbpf1hvph3x3u4ur6l6q5pa 192.138.137.18:2377

To add a manager to this swarm, run 'docker swarm join-token manager' and follow the instructions.

[x] Adding certificates and keys to Docker
nqm9w59kpzx1vbgju0704n6kw
n6itq4siyjvtbz2os9mxqtx55
kgc6g95svh4f8n8tyh30eqg3a
4x0laazcyr6v1g8un4t4c9zyx
bsjlm10wc077uqfide6c0nhle
hvdawltyirrgy5qmjm048o272
fbbyk2vdcc2cjsvzwmz7w10v6
[x] Updating logstash configuration with logstash writer
[x] Creating custom logstash conf
mlfct47zmtvlcsof6tf9z7qwz
nqsb16iqs0jgxe11f443u007c
vm.max_map_count = 262144
Creating network lme_esnet
service logstash: config not found: logstash_custom.conf
[x] Waiting for elasticsearch to be ready

Welcome to Ubuntu 18.04.3 LTS (GNU/Linux 4.15.0-72-generic x86_64)

• Documentation: https://help.ubuntu.com

[jordan-ncc]

Hi @Bwshort1, The issue may be due to an error in the install script.
This can be seen here:
service logstash: config not found: logstash_custom.conf

It has been fixed in PR #52 , Can you re-clone the repository and try the install again?

[ehosmer]

I just checked the deploy.sh the install steps copy to my box from git and it does not contain these recent changes.

[duncan-ncc]

Hi @ehosmer,
If you cd /opt/lme/Chapter\ 3\ Files/ and then run sudo git pull you will see that deploy.sh has been updated as per the Pull Request and Merge #52

[ehosmer]

This is from the file that was pulled with the setup I ran 1 hour ago. And its missing the lines you add a few hours ago.

function populatelogstashconfig() {
#add logstash conf to config
docker config create logstash.conf logstash.edited.conf

#add os mapping to config
docker config create osmap.csv osmap.csv
}

[duncan-ncc]

Hi @ehosmer,
#52 was only approved within the last hour and so only entered the master branch at 15:12 GMT.
Can you please pull from the repo as @jordan-ncc suggested and this should fix the issue you are experiencing

[ehosmer]

Better but still some install issue. I see it has created Docker Service lme_elasticseach but its still sitting at "Waiting for elasticsearch to be ready" after 90 Minutes.

Would the output from docker service logs -f lme_elasticsearch be helpful?
UPDATED: add to bottom of post

Also, while stuck I tired running the below command and this is returned.

About ready to just give up an look at another solution.

Last login: Wed Dec 11 18:19:06 2019 from 192.138.137.130
luser@orion:$ sudo bash
[sudo] password for luser:
root@orion:# curl --cacert /opt/lme/Chapter\ 3\ Files/certs/root-ca.crt --user elastic:temp https://127.0.0.1:9200
curl: (7) Failed to connect to 127.0.0.1 port 9200: Connection refused
root@orion:~#

login as: luser
[email protected]'s password:
Welcome to Ubuntu 18.04.3 LTS (GNU/Linux 4.15.0-55-generic x86_64)

• Documentation: https://help.ubuntu.com
• Management: https://landscape.canonical.com
• Support: https://ubuntu.com/advantage

System information as of Wed Dec 11 16:49:00 UTC 2019

System load: 0.0 Processes: 95
Usage of /: 2.3% of 244.58GB Users logged in: 0
Memory usage: 1% IP address for eth0: 192.138.137.18
Swap usage: 0%

0 packages can be updated.
0 updates are security updates.

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

To run a command as administrator (user "root"), use "sudo ".
See "man sudo_root" for details.

luser@orion:$ sudo apt update
[sudo] password for luser:
Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [9,184 B]
Get:6 http://archive.ubuntu.com/ubuntu bionic/restricted Translation-en [3,584 B]
Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [8,570 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic/universe Translation-en [4,941 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [151 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic/multiverse Translation-en [108 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [816 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [288 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [24.1 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [6,620 B]
Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,033 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [319 kB]
Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,284 B]
Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,508 B]
Get:19 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [2,512 B]
Get:20 http://archive.ubuntu.com/ubuntu bionic-backports/main Translation-en [1,644 B]
Get:21 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,028 B]
Get:22 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,856 B]
Get:23 http://archive.ubuntu.com/ubuntu bionic-security/main amd64 Packages [593 kB]
Get:24 http://archive.ubuntu.com/ubuntu bionic-security/main Translation-en [194 kB]
Get:25 http://archive.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [15.1 kB]
Get:26 http://archive.ubuntu.com/ubuntu bionic-security/restricted Translation-en [4,684 B]
Get:27 http://archive.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [626 kB]
Get:28 http://archive.ubuntu.com/ubuntu bionic-security/universe Translation-en [209 kB]
Get:29 http://archive.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,120 B]
Get:30 http://archive.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,600 B]
Fetched 18.2 MB in 6s (3,281 kB/s)
Reading package lists... Done
Building dependency tree
Reading state information... Done
99 packages can be upgraded. Run 'apt list --upgradable' to see them.
luser@orion:$ sudo apt install git -y
Reading package lists... Done
Building dependency tree
Reading state information... Done
Suggested packages:
git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk gitweb git-cvs git-mediawiki git-svn
The following packages will be upgraded:
git
1 upgraded, 0 newly installed, 0 to remove and 98 not upgraded.
Need to get 3,912 kB of archives.
After this operation, 49.2 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.5 [3,912 kB]
Fetched 3,912 kB in 1s (3,100 kB/s)
(Reading database ... 67033 files and directories currently installed.)
Preparing to unpack .../git_1%3a2.17.1-1ubuntu0.5_amd64.deb ...
Unpacking git (1:2.17.1-1ubuntu0.5) over (1:2.17.1-1ubuntu0.4) ...
Setting up git (1:2.17.1-1ubuntu0.5) ...
luser@orion:$ sudo git clone https://github.com/ukncsc/lme.git /opt/lme/
Cloning into '/opt/lme'...
remote: Enumerating objects: 89, done.
remote: Counting objects: 100% (89/89), done.
remote: Compressing objects: 100% (64/64), done.
remote: Total 358 (delta 48), reused 50 (delta 25), pack-reused 269
Receiving objects: 100% (358/358), 2.89 MiB | 13.32 MiB/s, done.
Resolving deltas: 100% (166/166), done.
luser@orion:$ cd /opt/lme/Chapter\ 3\ Files/
luser@orion:/opt/lme/Chapter 3 Files$ ll
total 60
drwxr-xr-x 2 root root 4096 Dec 11 16:50 ./
drwxr-xr-x 9 root root 4096 Dec 11 16:50 ../
-rwxr-xr-x 1 root root 363 Dec 11 16:50 dashboard_update.sh*
-rwxr-xr-x 1 root root 25511 Dec 11 16:50 deploy.sh*
-rw-r--r-- 1 root root 3811 Dec 11 16:50 docker-compose-stack.yml
-rwxr-xr-x 1 root root 56 Dec 11 16:50 lme_update.sh*
-rw-r--r-- 1 root root 2355 Dec 11 16:50 logstash.conf
-rw-r--r-- 1 root root 270 Dec 11 16:50 osmap.csv
-rw-r--r-- 1 root root 288 Dec 11 16:50 winlogbeat.yml
luser@orion:/opt/lme/Chapter 3 Files$ sudo git pull
Already up to date.
luser@orion:/opt/lme/Chapter 3 Files$ cd /opt/lme/Chapter\ 3\ Files/
luser@orion:/opt/lme/Chapter 3 Files$ sudo ./deploy.sh install
[x] Installing prerequisites
Reading package lists...
Building dependency tree...
Reading state information...
net-tools is already the newest version (1.60+git20161116.90da8a0-1ubuntu1).
net-tools set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 98 not upgraded.
Enter the IP that winlogbeat will use to communicate with this box: 192.138.137.18
Enter the DNS name that winlogbeat uses to communicate with this box: orion.kettering.edu
[x] Configuring winlogbeat config and certificates to use 192.138.137.18 as the IP and orion.kettering.edu as the DNS
This OS was detected as: ubuntu
[x] Configuring Auto Updates
Reading package lists...
Building dependency tree...
Reading state information...
Suggested packages:
bsd-mailx default-mta | mail-transport-agent needrestart
The following packages will be upgraded:
unattended-upgrades
1 upgraded, 0 newly installed, 0 to remove and 97 not upgraded.
Need to get 41.7 kB of archives.
After this operation, 24.6 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 unattended-upgrades all 1.1ubuntu1.18.04.13 [41.7 kB]
Fetched 41.7 kB in 0s (97.1 kB/s)
Preconfiguring packages ...
(Reading database ... 67033 files and directories currently installed.)
Preparing to unpack .../unattended-upgrades_1.1ubuntu1.18.04.13_all.deb ...
Unpacking unattended-upgrades (1.1ubuntu1.18.04.13) over (1.1ubuntu1.18.04.11) ...
Processing triggers for ureadahead (0.100.0-21) ...
Processing triggers for systemd (237-3ubuntu10.24) ...
Setting up unattended-upgrades (1.1ubuntu1.18.04.13) ...
Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
grep: grep: No such file or directory
grep: APT::Periodic::Update-Package-Lists "1";: No such file or directory
grep: grep: No such file or directory
grep: APT::Periodic::Unattended-Upgrade "1";: No such file or directory
grep: grep: No such file or directory
grep: APT::Periodic::Download-Upgradeable-Packages "1";: No such file or directory
This script will use self signed certificates for communication and encryption, Do you want to continue with self signed certificates? ([y]es/[n]o): y
[x] making root CA
Generating RSA private key, 4096 bit long modulus (2 primes)
...................................................................................................................................................................................++++
............................++++
e is 65537 (0x010001)
Can't load /home/luser/.rnd into RNG
140015553348032:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/luser/.rnd
[x] Signing root CA
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = Swarm
Getting Private key
[x] Making logstash Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
.......................................++++
.................++++
e is 65537 (0x010001)
Can't load /home/luser/.rnd into RNG
140249189687744:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/luser/.rnd
[x] Signing logstash cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = orion.kettering.edu
Getting CA Private Key
[x] Making wlbclient Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
..........................................................++++
.................++++
e is 65537 (0x010001)
Can't load /home/luser/.rnd into RNG
140162211123648:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/luser/.rnd
[x] Signing wlbclient cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = wlbclient
Getting CA Private Key
[x] Making logstash Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
................................................................................................++++
..........................++++
e is 65537 (0x010001)
Can't load /home/luser/.rnd into RNG
139952073490880:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/luser/.rnd
[x] Sign elasticsearch cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = elasticsearch
Getting CA Private Key
[x] Making logstash Cert
Generating RSA private key, 4096 bit long modulus (2 primes)
.....................++++
......++++
e is 65537 (0x010001)
Can't load /home/luser/.rnd into RNG
140185651306944:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/luser/.rnd
[x] Sign kibana cert
Signature ok
subject=C = GB, ST = UK, L = London, O = Docker, CN = kibana
Getting CA Private Key
[x] Installing curl to get the docker convenience script
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
libcurl4
The following packages will be upgraded:
curl libcurl4
2 upgraded, 0 newly installed, 0 to remove and 95 not upgraded.
Need to get 373 kB of archives.
After this operation, 2,048 B of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 curl amd64 7.58.0-2ubuntu3.8 [159 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libcurl4 amd64 7.58.0-2ubuntu3.8 [214 kB]
Fetched 373 kB in 1s (431 kB/s)
(Reading database ... 67036 files and directories currently installed.)
Preparing to unpack .../curl_7.58.0-2ubuntu3.8_amd64.deb ...
Unpacking curl (7.58.0-2ubuntu3.8) over (7.58.0-2ubuntu3.7) ...
Preparing to unpack .../libcurl4_7.58.0-2ubuntu3.8_amd64.deb ...
Unpacking libcurl4:amd64 (7.58.0-2ubuntu3.8) over (7.58.0-2ubuntu3.7) ...
Setting up libcurl4:amd64 (7.58.0-2ubuntu3.8) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
Setting up curl (7.58.0-2ubuntu3.8) ...
[x] Installing docker

• sh -c apt-get update -qq >/dev/null
• sh -c DEBIAN_FRONTEND=noninteractive apt-get install -y -qq apt-transport-https ca-certificates curl >/dev/null
• sh -c curl -fsSL "https://download.docker.com/linux/ubuntu/gpg" | apt-key add -qq - >/dev/null
  Warning: apt-key output should not be parsed (stdout is not a terminal)
• sh -c echo "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable" > /etc/apt/sources.list.d/docker.list
• sh -c apt-get update -qq >/dev/null
• [ -n ]
• sh -c apt-get install -y -qq --no-install-recommends docker-ce >/dev/null
• sh -c docker version
  [x] Configuring docker swarm
  Swarm initialized: current node (st6wwfdbuostikhx1jmzwu247) is now a manager.

To add a worker to this swarm, run the following command:

docker swarm join --token SWMTKN-1-5s4kj7419zjhop2g2fhnwbl4k14asi0xg2pj4mr41wm945mqrz-4b623shuoiz1hrg1cq5466p2a 192.138.137.18:2377

To add a manager to this swarm, run 'docker swarm join-token manager' and follow the instructions.

[x] Adding certificates and keys to Docker
xj9sugjog4hlzf2xtefunnlyu
dnfcjx9yd0n1l0wy70yb5aprs
d2n5oj3sniigjw6a8irjazatr
ljzutxwzib6sm07t03l0tk0hz
um10v76wqign77sx7kmxybj9z
eyq3rdsdrm621i3d5wr8dbk29
xle2rl66y7obqu02xbhd79u5j
[x] Updating logstash configuration with logstash writer
[x] Creating custom logstash conf
twbsc3p8n65ebhqh28vud8nx7
[x] Custom logstash config exists, Not creating
sqxd9q8a64lysllgq8u32w8g0
xg4pp2zk73zyblqj605o5j46j
vm.max_map_count = 262144
Creating network lme_esnet
Creating service lme_elasticsearch
Creating service lme_kibana
Creating service lme_logstash
[x] Waiting for elasticsearch to be ready

lme_elasticsearch.1.gn2xbp9y7lmi@orion | Created elasticsearch keystore in /usr/share/elasticsearch/config
lme_elasticsearch.1.gn2xbp9y7lmi@orion | OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:02,647Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda2)]], net usable_space [222.7g b], net total_space [244.5gb], types [ext4]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:02,659Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "heap size [10.9gb], compressed ordinary object pointers [true]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:02,665Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "node name [es01], node ID [0nEmEIqsTtaU68Gx75-gSg], cluster name [loggingmadeeasy-es]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:02,666Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "version[7.4.0], pid[15], build[default/docker/22e1767283e61a198cb4db791ea66e3f11ab9910/2019-09-27T08:36:48.5694 19Z], OS[Linux/4.15.0-55-generic/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/13/13+33]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:02,668Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM home [/usr/share/elasticsearch/jdk]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:02,669Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSIniti atingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encodi ng=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread= 0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-6449334591875729474, -XX :+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecoun t=32,filesize=64m, -Djava.locale.providers=COMPAT, -Des.cgroups.hierarchy.override=/, -Xms11g, -Xmx11g, -Dio.netty.allocator.type=pooled, -XX:MaxDirectMemorySize=590 5580032, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -D es.bundled_jdk=true]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,637Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [aggs-matrix-stats]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,638Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [analysis-common]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,639Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [data-frame]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,642Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [flattened]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,642Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [frozen-indices]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,644Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-common]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,645Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-geoip]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,646Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-user-agent]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,647Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-expression]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,648Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-mustache]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,649Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-painless]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,650Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [mapper-extras]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,651Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [parent-join]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,652Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [percolator]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,653Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [rank-eval]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,654Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [reindex]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,654Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [repository-url]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,655Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [search-business-rules]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,656Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [spatial]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,657Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [transport-netty4]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,658Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [vectors]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,659Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-analytics]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,660Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ccr]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,661Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-core]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,662Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-deprecation]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,663Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-graph]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,664Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ilm]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,665Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-logstash]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,666Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ml]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,667Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-monitoring]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,668Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-rollup]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,669Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-security]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,670Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-sql]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,671Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-voting-only-node]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,673Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-watcher]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:07,674Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "no plugins loaded" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:15,612Z", "level": "INFO", "component": "o.e.x.s.a.s.FileRolesStore", " cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]" }
lme_elasticsearch.1.gn2xbp9y7lmi@orion | {"type": "server", "timestamp": "2019-12-11T18:31:26,965Z", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExc eptionHandler", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "uncaught exception in thread [main]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failure running machine learning nat ive code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by ru nning Elasticsearch without machine learning functionality set [xpack.ml.enabled: false].]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.4.0.jar:7.4. 0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "Caused by: org.elasticsearch.ElasticsearchException: Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without mac hine learning functionality set [xpack.ml.enabled: false].",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:524) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.node.Node.lambda$new$9(Node.java:450) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1621) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.node.Node.(Node.java:453) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.node.Node.(Node.java:255) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:221) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.gn2xbp9y7lmi@orion | "... 6 more"] }
lme_elasticsearch.1.7pal4giaskms@orion | Created elasticsearch keystore in /usr/share/elasticsearch/config
lme_elasticsearch.1.7pal4giaskms@orion | OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:31:58,298Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda2)]], net usable_space [222.7g b], net total_space [244.5gb], types [ext4]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:31:58,313Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "heap size [10.9gb], compressed ordinary object pointers [true]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:31:58,317Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "node name [es01], node ID [0nEmEIqsTtaU68Gx75-gSg], cluster name [loggingmadeeasy-es]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:31:58,318Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "version[7.4.0], pid[9], build[default/docker/22e1767283e61a198cb4db791ea66e3f11ab9910/2019-09-27T08:36:48.56941 9Z], OS[Linux/4.15.0-55-generic/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/13/13+33]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:31:58,319Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM home [/usr/share/elasticsearch/jdk]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:31:58,320Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSIniti atingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encodi ng=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread= 0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-18018185736923507580, -X X:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecou nt=32,filesize=64m, -Djava.locale.providers=COMPAT, -Des.cgroups.hierarchy.override=/, -Xms11g, -Xmx11g, -Dio.netty.allocator.type=pooled, -XX:MaxDirectMemorySize=59 05580032, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, - Des.bundled_jdk=true]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,567Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [aggs-matrix-stats]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,568Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [analysis-common]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,572Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [data-frame]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,573Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [flattened]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,573Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [frozen-indices]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,575Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-common]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,578Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-geoip]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,585Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-user-agent]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,585Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-expression]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,586Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-mustache]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,586Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-painless]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,586Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [mapper-extras]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,587Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [parent-join]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,589Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [percolator]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,591Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [rank-eval]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,591Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [reindex]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,591Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [repository-url]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,593Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [search-business-rules]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,593Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [spatial]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,595Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [transport-netty4]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,595Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [vectors]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,595Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-analytics]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,596Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ccr]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,597Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-core]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,599Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-deprecation]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,599Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-graph]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,599Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ilm]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,601Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-logstash]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,601Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ml]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,601Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-monitoring]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,602Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-rollup]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,602Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-security]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,602Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-sql]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,604Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-voting-only-node]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,605Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-watcher]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:03,606Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "no plugins loaded" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:11,971Z", "level": "INFO", "component": "o.e.x.s.a.s.FileRolesStore", " cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]" }
lme_elasticsearch.1.7pal4giaskms@orion | {"type": "server", "timestamp": "2019-12-11T18:32:23,405Z", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExc eptionHandler", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "uncaught exception in thread [main]",
lme_elasticsearch.1.7pal4giaskms@orion | "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failure running machine learning nat ive code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by ru nning Elasticsearch without machine learning functionality set [xpack.ml.enabled: false].]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.4.0.jar:7.4. 0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "Caused by: org.elasticsearch.ElasticsearchException: Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without mac hine learning functionality set [xpack.ml.enabled: false].",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:524) ~[?:?]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.node.Node.lambda$new$9(Node.java:450) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | Created elasticsearch keystore in /usr/share/elasticsearch/config
lme_elasticsearch.1.98vfjdoprpl4@orion | OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:10,206Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda2)]], net usable_space [222.7g b], net total_space [244.5gb], types [ext4]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:10,216Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "heap size [10.9gb], compressed ordinary object pointers [true]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:10,224Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "node name [es01], node ID [0nEmEIqsTtaU68Gx75-gSg], cluster name [loggingmadeeasy-es]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:10,226Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "version[7.4.0], pid[10], build[default/docker/22e1767283e61a198cb4db791ea66e3f11ab9910/2019-09-27T08:36:48.5694 19Z], OS[Linux/4.15.0-55-generic/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/13/13+33]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:10,227Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM home [/usr/share/elasticsearch/jdk]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:10,227Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSIniti atingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encodi ng=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread= 0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-8171221571594013986, -XX :+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecoun t=32,filesize=64m, -Djava.locale.providers=COMPAT, -Des.cgroups.hierarchy.override=/, -Xms11g, -Xmx11g, -Dio.netty.allocator.type=pooled, -XX:MaxDirectMemorySize=590 5580032, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -D es.bundled_jdk=true]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,230Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [aggs-matrix-stats]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,234Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [analysis-common]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,235Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [data-frame]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,235Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [flattened]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,235Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [frozen-indices]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,236Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-common]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,239Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-geoip]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,240Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-user-agent]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,240Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-expression]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,240Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-mustache]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,240Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-painless]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,241Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [mapper-extras]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,242Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [parent-join]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,243Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [percolator]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,244Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [rank-eval]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,245Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [reindex]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,245Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [repository-url]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,245Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [search-business-rules]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,247Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [spatial]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,248Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [transport-netty4]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,251Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [vectors]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,251Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-analytics]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,252Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ccr]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,252Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-core]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,252Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-deprecation]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,253Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-graph]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,254Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ilm]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,254Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-logstash]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,254Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ml]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,255Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-monitoring]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,255Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-rollup]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,255Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-security]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,257Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-sql]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,257Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-voting-only-node]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,257Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-watcher]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:15,258Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluste r.name": "loggingmadeeasy-es", "node.name": "es01", "message": "no plugins loaded" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:23,119Z", "level": "INFO", "component": "o.e.x.s.a.s.FileRolesStore", " cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]" }
lme_elasticsearch.1.98vfjdoprpl4@orion | {"type": "server", "timestamp": "2019-12-11T18:29:34,611Z", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExc eptionHandler", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "uncaught exception in thread [main]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failure running machine learning nat ive code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by ru nning Elasticsearch without machine learning functionality set [xpack.ml.enabled: false].]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.4.0.jar:7.4. 0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "Caused by: org.elasticsearch.ElasticsearchException: Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without mac hine learning functionality set [xpack.ml.enabled: false].",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:524) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.node.Node.lambda$new$9(Node.java:450) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1621) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.node.Node.(Node.java:453) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.node.Node.(Node.java:255) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:221) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.98vfjdoprpl4@orion | "... 6 more"] }
lme_elasticsearch.1.7pal4giaskms@orion | "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1621) ~[?:?]",
lme_elasticsearch.1.7pal4giaskms@orion | "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]",
lme_elasticsearch.1.7pal4giaskms@orion | "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]",
lme_elasticsearch.1.7pal4giaskms@orion | "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]",
lme_elasticsearch.1.7pal4giaskms@orion | "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]",
lme_elasticsearch.1.7pal4giaskms@orion | "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.node.Node.(Node.java:453) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.node.Node.(Node.java:255) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:221) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0.jar:7.4.0]",
lme_elasticsearch.1.7pal4giaskms@orion | "... 6 more"] }

lme_elasticsearch.1.fx0adi1m12nn@orion | Created elasticsearch keystore in /usr/share/elasticsearch/config
lme_elasticsearch.1.fx0adi1m12nn@orion | OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:49,855Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda2)]], net usable_space [222.7g b], net total_space [244.5gb], types [ext4]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:49,864Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "clust er.name": "loggingmadeeasy-es", "node.name": "es01", "message": "heap size [10.9gb], compressed ordinary object pointers [true]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:49,871Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "node name [es01], node ID [0nEmEIqsTtaU68Gx75-gSg], cluster name [loggingmadeeasy-es]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:49,873Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "version[7.4.0], pid[9], build[default/docker/22e1767283e61a198cb4db791ea66e3f11ab9910/2019-09-27T08:36:48.56941 9Z], OS[Linux/4.15.0-55-generic/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/13/13+33]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:49,879Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM home [/usr/share/elasticsearch/jdk]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:49,882Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": " loggingmadeeasy-es", "node.name": "es01", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSIniti atingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encodi ng=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread= 0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-5119452908872188549, -XX :+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecoun t=32,filesize=64m, -Djava.locale.providers=COMPAT, -Des.cgroups.hierarchy.override=/, -Xms11g, -Xmx11g, -Dio.netty.allocator.type=pooled, -XX:MaxDirectMemorySize=590 5580032, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -D es.bundled_jdk=true]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,816Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [aggs-matrix-stats]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,817Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [analysis-common]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,817Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [data-frame]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,817Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [flattened]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,818Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [frozen-indices]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,818Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-common]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,818Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-geoip]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,819Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-user-agent]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,819Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-expression]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,820Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-mustache]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,820Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-painless]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,821Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [mapper-extras]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,821Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [parent-join]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,822Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [percolator]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,822Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [rank-eval]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,822Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [reindex]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,823Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [repository-url]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,823Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [search-business-rules]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,824Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [spatial]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,824Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [transport-netty4]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,825Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [vectors]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,825Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-analytics]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,825Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ccr]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,826Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-core]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,826Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-deprecation]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,826Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-graph]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,826Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ilm]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,827Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-logstash]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,827Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ml]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,827Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-monitoring]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,827Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-rollup]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,828Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-security]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,828Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-sql]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,828Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-voting-only-node]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,828Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-watcher]" }
lme_elasticsearch.1.fx0adi1m12nn@orion | {"type": "server", "timestamp": "2019-12-11T18:33:54,829Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "no plugins loaded" }

[ehosmer]

I give up!

[Bwshort1]

I have just tried installing again but its hanging at "Waiting for elasticsearch to be ready" still.

The odd bit is if I try install this on my home network, using public proxy settings ( and without proxy settings ) the install completes successfully. I suspect that there is something on my clients network affecting this install.
I've got a meeting with the chaps at NCSC in January about this issue. Hopefully they could identify the root cause.

[duncan-ncc]

@ehosmer - Are you running this on bare metal? The error in your logs "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failure running machine learning nat ive code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. appears to lean towards the issue potentially being the lack of SSE4.2 instructions

@Bwshort1 - Sounds good, I expect the issue will be resolved much more easily that way vs github back and forth.

[ehosmer]

Installed Server Version of Ubuntu 18.04.3 LTS (GNU/Linux 4.15.0-55-generic x86_64). And the vlan this server is on does not need to use proxy.

[ehosmer]

@Bwshort1 I think what there saying is were installing on our Ubuntu VM's on outdated hosting hardware that does not support everything. I used a really old hosting test server 11+. (SUN hardware lasts)

Trying this on one of my hosting Hyper-v servers that is only only 4 years old now. Will see how that goes.

[duncan-ncc]

@ehosmer - If you are using an old SUN box it would be likely that it doesn't support the SSE4.2 instruction set.
bwshort1's issue is likely to be the proxy as he states it works fine without it.

[duncan-ncc]

I shall close this issue now that your problem is resolved!