Member since
06-22-2016
16
Posts
5
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2370 | 07-05-2016 07:28 AM |
08-02-2016
12:18 PM
Thanks for all your response, i have resolved this issue, it is related with my local DNS server settings which makes my hostname different with what i am setting for each agent, so the agent could not find the correct hostname and the ip for others. after i removed my local DNS server and place back the /etc/hosts files to point all the hosts it comes back. Thanks All.
... View more
08-01-2016
03:14 AM
I setup my ambari cluster before by using FQDN to add hosts(add hosts file for all the cluster servers), and due to the local DNS change, we updated the IPs for all the servers in the cluster, and point the server's resolv.conf to the new DNS server, but after i restart all the servers and the ambari, the ambari-UI still shows the old IP address for the hosts. I can ping the hostname in each server and get the correct IP address responsed. any idea on this?
... View more
Labels:
- Labels:
-
Apache Ambari
07-05-2016
07:28 AM
1 Kudo
Thanks Timothy, i found that one of my notebook got an very large json data when it is loading which cost too much resources and makes the socket connection failed, i manually deleted that notebook and everything comes back. Thanks very much for your response.
... View more
07-04-2016
06:41 AM
2 Kudos
Hi: I have installed the zeppelin notebook in the ambari cluster, and it used to working well before, but from these days, it always not responsed, but when i restart the zeppelin service it will come back. I checked the zeppelin log and found that it shows the socket error repeated. does anyone meet this error? ERROR [2016-07-04 14:42:35,388] ({pool-1-thread-27} NotebookServer.java[broadcast]:306) - socket error
java.io.IOException: closedOut 1000:Idle for 300051ms > 300000ms
at org.eclipse.jetty.websocket.WebSocketConnectionRFC6455$WSFrameConnection.sendMessage(WebSocketConnectionRFC6455.java:437)
at org.apache.zeppelin.socket.NotebookSocket.send(NotebookSocket.java:69)
at org.apache.zeppelin.socket.NotebookServer.broadcast(NotebookServer.java:304)
at org.apache.zeppelin.socket.NotebookServer.broadcastNote(NotebookServer.java:376)
at org.apache.zeppelin.socket.NotebookServer$ParagraphListenerImpl.afterStatusChange(NotebookServer.java:1099)
at org.apache.zeppelin.scheduler.Job.setStatus(Job.java:150)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.afterStatusChange(RemoteScheduler.java:408)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:272)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:341)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
... View more
Labels:
- Labels:
-
Apache Zeppelin
06-26-2016
04:21 AM
Hi @Matt Foley: Thanks very much for your response. actually i have followed this article and both 3 points were yes for me. since i am not a fresh installation, after i checked my cluster again i found that the version is different between my master and the new host, not sure why it happened, i just upgraded my Ambari-server and ambari-agent, and re-deployed to the new host server, it works. Thanks very much.
... View more
06-24-2016
08:00 AM
I saw it show me it is incorrect stack version 2.4.2.0-258, but from my ambari page in the version/stack, it show the version is HDP-2.4.2.0-258..not sure why.
... View more
06-24-2016
07:45 AM
1 Kudo
I created a local repo, and i also updated the version/stack to make my ambari connect to my local repo, but when i try to add a new host and deploy on it, the installation always got failed. Here is the output from ambari: stderr: /var/lib/ambari-agent/data/errors-884.txt Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 35, in <module>
BeforeAnyHook().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 26, in hook
import params
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py", line 187, in <module>
hadoop_conf_dir = conf_select.get_hadoop_conf_dir(force_latest_on_upgrade=True)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/conf_select.py", line 374, in get_hadoop_conf_dir
select(stack_name, "hadoop", version)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/conf_select.py", line 252, in select
shell.checked_call(get_cmd("set-conf-dir", package, version), logoutput=False, quiet=False, sudo=True)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'conf-select set-conf-dir --package hadoop --stack-version 2.4.2.0-258 --conf-version 0' returned 1. 2.4.2.0-258 Incorrect stack version
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-884.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-884.json', 'INFO', '/var/lib/ambari-agent/tmp'] stdout: /var/lib/ambari-agent/data/output-884.txt 2016-06-24 15:38:55,956 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.2.0-258
2016-06-24 15:38:55,956 - Checking if need to create versioned conf dir /etc/hadoop/2.4.2.0-258/0
2016-06-24 15:38:55,956 - call['conf-select create-conf-dir --package hadoop --stack-version 2.4.2.0-258 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2016-06-24 15:38:55,988 - call returned (1, '2.4.2.0-258 Incorrect stack version', '')
2016-06-24 15:38:55,988 - checked_call['conf-select set-conf-dir --package hadoop --stack-version 2.4.2.0-258 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False}
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-884.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-884.json', 'INFO', '/var/lib/ambari-agent/tmp']
... View more
Labels:
06-22-2016
08:03 AM
Thanks very much, what i am finding is the place to set my repository URL in Ambari->Admin->Vesions, i have already removed unneccessary repo files yet, let me update the set of repo in Ambari and have another try.
... View more
06-22-2016
07:38 AM
I have setup a cluster of Hortonworks Data Platform, and it was using the default BaseURL for the Repo, but due to some network change, the connection to the default URL is very very slow now so i tried to setup a local repo in my own server. I have already setup the local repo in one of my server, and updated the repo files in my HDP cluster servers, but when i try to add a new host, it still using the default repo URL even if i have already updated the yum repo file in the new server etc folder. is there any suggestions on this question? thanks very very much for your hhelps.
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)