Comments (7)
It looks like Ambari tried to install the cluster, but failed. If you click on the grey button on the header which says 0 ops you can select the failed task and it will show you some logs. Could you please take a look at it what does it say?
from docker-ambari.
I drilled down as per the screenshots, into ambo and then into the part about App Timeline Server Start. The error messages are pasted below:
stderr:
2014-10-01 01:03:59,246 - Error while executing command 'start':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 42, in start
service('timelineserver', action='start')
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 59, in service
initial_wait=5
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
raise ex
Fail: Execution of 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1' returned 1.
stdout:
2014-10-01 01:03:52,594 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/; curl -kf -x "" --retry 10 http://amb0.mycorp.kom:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] {'environment': ..., 'not_if': 'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip', 'ignore_failures': True, 'path': ['/bin', '/usr/bin/']}
2014-10-01 01:03:52,603 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/; curl -kf -x "" --retry 10 http://amb0.mycorp.kom:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] due to not_if
2014-10-01 01:03:52,703 - Directory['/etc/hadoop/conf.empty'] {'owner': 'root', 'group': 'root', 'recursive': True}
2014-10-01 01:03:52,705 - Link['/etc/hadoop/conf'] {'not_if': 'ls /etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'}
2014-10-01 01:03:52,714 - Skipping Link['/etc/hadoop/conf'] due to not_if
2014-10-01 01:03:52,725 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'}
2014-10-01 01:03:52,726 - XmlConfig['core-site.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...}
2014-10-01 01:03:52,736 - Generating config: /etc/hadoop/conf/core-site.xml
2014-10-01 01:03:52,736 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2014-10-01 01:03:52,737 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
2014-10-01 01:03:52,746 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
2014-10-01 01:03:52,755 - Skipping Execute['/bin/echo 0 > /selinux/enforce'] due to only_if
2014-10-01 01:03:52,757 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-i386-32; ln -sf /usr/lib/libsnappy.so /usr/lib/hadoop/lib/native/Linux-i386-32/libsnappy.so'] {}
2014-10-01 01:03:52,769 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-amd64-64; ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/libsnappy.so'] {}
2014-10-01 01:03:52,779 - Directory['/var/log/hadoop'] {'owner': 'root', 'group': 'hadoop', 'mode': 0775, 'recursive': True}
2014-10-01 01:03:52,780 - Directory['/var/run/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True}
2014-10-01 01:03:52,780 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'recursive': True}
2014-10-01 01:03:52,785 - File['/etc/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2014-10-01 01:03:52,786 - File['/etc/hadoop/conf/health_check'] {'content': Template('health_check-v2.j2'), 'owner': 'hdfs'}
2014-10-01 01:03:52,787 - File['/etc/hadoop/conf/log4j.properties'] {'content': '...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2014-10-01 01:03:52,788 - File['/etc/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
2014-10-01 01:03:52,789 - File['/etc/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2014-10-01 01:03:52,789 - File['/etc/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2014-10-01 01:03:53,040 - Directory['/var/run/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
2014-10-01 01:03:53,041 - Directory['/var/log/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
2014-10-01 01:03:53,042 - Directory['/var/run/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
2014-10-01 01:03:53,042 - Directory['/var/log/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
2014-10-01 01:03:53,042 - Directory['/hadoop/yarn/local'] {'owner': 'yarn', 'ignore_failures': True, 'recursive': True}
2014-10-01 01:03:53,043 - Directory['/hadoop/yarn/log'] {'owner': 'yarn', 'ignore_failures': True, 'recursive': True}
2014-10-01 01:03:53,043 - Directory['/var/log/hadoop-yarn'] {'owner': 'yarn', 'ignore_failures': True, 'recursive': True}
2014-10-01 01:03:53,043 - XmlConfig['core-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'hdfs', 'configurations': ...}
2014-10-01 01:03:53,057 - Generating config: /etc/hadoop/conf/core-site.xml
2014-10-01 01:03:53,057 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2014-10-01 01:03:53,058 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
2014-10-01 01:03:53,059 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
2014-10-01 01:03:53,069 - Generating config: /etc/hadoop/conf/mapred-site.xml
2014-10-01 01:03:53,069 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2014-10-01 01:03:53,071 - Writing File['/etc/hadoop/conf/mapred-site.xml'] because contents don't match
2014-10-01 01:03:53,071 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 495 to yarn
2014-10-01 01:03:53,071 - XmlConfig['yarn-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
2014-10-01 01:03:53,081 - Generating config: /etc/hadoop/conf/yarn-site.xml
2014-10-01 01:03:53,081 - File['/etc/hadoop/conf/yarn-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2014-10-01 01:03:53,083 - Writing File['/etc/hadoop/conf/yarn-site.xml'] because contents don't match
2014-10-01 01:03:53,083 - XmlConfig['capacity-scheduler.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
2014-10-01 01:03:53,093 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2014-10-01 01:03:53,093 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2014-10-01 01:03:53,094 - Writing File['/etc/hadoop/conf/capacity-scheduler.xml'] because contents don't match
2014-10-01 01:03:53,094 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 496 to yarn
2014-10-01 01:03:53,094 - Directory['/var/log/hadoop-yarn/timeline'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
2014-10-01 01:03:53,095 - Creating directory Directory['/var/log/hadoop-yarn/timeline']
2014-10-01 01:03:53,095 - Changing owner for /var/log/hadoop-yarn/timeline from 0 to yarn
2014-10-01 01:03:53,095 - Changing group for /var/log/hadoop-yarn/timeline from 0 to hadoop
2014-10-01 01:03:53,095 - File['/etc/hadoop/conf/yarn.exclude'] {'owner': 'yarn', 'group': 'hadoop'}
2014-10-01 01:03:53,098 - File['/etc/security/limits.d/yarn.conf'] {'content': Template('yarn.conf.j2'), 'mode': 0644}
2014-10-01 01:03:53,100 - File['/etc/security/limits.d/mapreduce.conf'] {'content': Template('mapreduce.conf.j2'), 'mode': 0644}
2014-10-01 01:03:53,105 - File['/etc/hadoop/conf/yarn-env.sh'] {'content': InlineTemplate(...), 'owner': 'yarn', 'group': 'hadoop', 'mode': 0755}
2014-10-01 01:03:53,107 - File['/etc/hadoop/conf/mapred-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'}
2014-10-01 01:03:53,109 - File['/etc/hadoop/conf/taskcontroller.cfg'] {'content': Template('taskcontroller.cfg.j2'), 'owner': 'hdfs'}
2014-10-01 01:03:53,110 - XmlConfig['mapred-site.xml'] {'owner': 'mapred', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...}
2014-10-01 01:03:53,120 - Generating config: /etc/hadoop/conf/mapred-site.xml
2014-10-01 01:03:53,120 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'mapred', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2014-10-01 01:03:53,121 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 497 to mapred
2014-10-01 01:03:53,122 - XmlConfig['capacity-scheduler.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...}
2014-10-01 01:03:53,131 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2014-10-01 01:03:53,132 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2014-10-01 01:03:53,132 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 497 to hdfs
2014-10-01 01:03:53,133 - File['/etc/hadoop/conf/ssl-client.xml.example'] {'owner': 'mapred', 'group': 'hadoop'}
2014-10-01 01:03:53,133 - File['/etc/hadoop/conf/ssl-server.xml.example'] {'owner': 'mapred', 'group': 'hadoop'}
2014-10-01 01:03:53,134 - File['/var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid'] {'action': ['delete'], 'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1'}
2014-10-01 01:03:53,144 - Execute['ulimit -c unlimited; export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh --config /etc/hadoop/conf start timelineserver'] {'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1', 'user': 'yarn'}
2014-10-01 01:03:54,194 - Execute['ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1'] {'initial_wait': 5, 'not_if': 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1', 'user': 'yarn'}
2014-10-01 01:03:59,246 - Error while executing command 'start':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 42, in start
service('timelineserver', action='start')
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 59, in service
initial_wait=5
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
raise ex
Fail: Execution of 'ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid` >/dev/null 2>&1' returned 1.
from docker-ambari.
I just tried the same and failed when Ambari tried to start the App Timeline Server, some python issues. 1.7.0-ea is based on the Ambari trunk repo and is constantly evolving so I suggest you to pull the sequenceiq/ambari:1.6.0 docker image and set the IMAGE=sequenceiq/ambari:1.6.0 and you can use the same amb-deploy-cluster 4 function. In the meanwhile I'll dig deeper to find the root cause of the problem.
from docker-ambari.
It looks like there are some issues with a few components not only with the App Timeline Server. https://issues.apache.org/jira/browse/AMBARI-7557
from docker-ambari.
You can track the progress of this particular issue here but in the meanwhile as I suggested above use the sequenceiq/ambari:1.6.0 image.
from docker-ambari.
I am busy pulling the image now, will let you know what happens
On Wed, Oct 1, 2014 at 9:10 AM, Krisztian Horvath [email protected]
wrote:
You can track the progress of this particular issue here
https://issues.apache.org/jira/browse/AMBARI-7578 but in the meanwhile
as I suggested above use the sequenceiq/ambari:1.6.0 image.—
Reply to this email directly or view it on GitHub
#12 (comment)
.
from docker-ambari.
It works! Thanks
On Wed, Oct 1, 2014 at 9:12 AM, Lee Brooks [email protected] wrote:
I am busy pulling the image now, will let you know what happens
On Wed, Oct 1, 2014 at 9:10 AM, Krisztian Horvath <
[email protected]> wrote:You can track the progress of this particular issue here
https://issues.apache.org/jira/browse/AMBARI-7578 but in the meanwhile
as I suggested above use the sequenceiq/ambari:1.6.0 image.—
Reply to this email directly or view it on GitHub
#12 (comment)
.
from docker-ambari.
Related Issues (20)
- public-hostname.sh no longer works in non-cloud environment. HOT 1
- Some questions : start, commit, restart... HOT 7
- can't work correctly in cloudbreak HOT 5
- ambari agent failed to start
- Why change SSHD port to 2022? HOT 4
- Best way to deploy with java 8 HOT 3
- hbase not working with blueprints HOT 3
- Install Apache Spark HOT 4
- Is it impossible to install HDP-1.3 stack by sequenceiq/ambari:1.7.0 image? HOT 2
- Best/Recommended upgrade path from Ambari 2.1/HDP 2.3 to Ambari 2.2/HDP 2.4 ? HOT 2
- mysql-connector-java-5.1.17.jar is outdated and doesn't work with RDS HOT 1
- RFI: Where is Dockerfile for sequenceiq/consul HOT 3
- Needs update to Ambari 2.4.1.0 & HDP 2.5 HOT 4
- What SSH private key can be used HOT 1
- Question: How can I access the Ambari UI from outside the host? HOT 3
- How to create Ambari cluster HOT 2
- How to change the value of USE_CONSUL_DNS HOT 1
- Image doesn't contain "which" command HOT 1
- Be able to customize the public ip resolver script
- Changing base url in ambari.repo to use latest version of Ambari doesnt take effect HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docker-ambari.