Member since
12-28-2015
74
Posts
17
Kudos Received
7
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2172 | 05-17-2017 03:15 PM | |
| 7617 | 03-21-2017 11:35 AM | |
| 14914 | 03-04-2017 09:51 AM | |
| 2657 | 02-09-2017 04:03 PM | |
| 4695 | 01-19-2017 11:24 AM |
09-07-2017
07:00 PM
Is this one way trust encrypted between kdc and ad?
... View more
02-10-2017
02:14 AM
Thank you that was well answered.
... View more
02-07-2017
04:31 PM
It worked! The servicecomponentdesiredstate_id_seq was missing. Thank you very much!
... View more
02-02-2017
02:09 PM
Excellent, I will review the language in documentation and issue a pull request to change. Sorry for confusion.
... View more
04-20-2017
05:56 PM
hi Team, This is pawan gir new to the hadoop world, m trying to install zookeeper on ambari server and its throwing below error. Hi Sir,
I'm trying to install ambari agent on VMs but it has some issue, please help me to close this issue, PFB the error.
stderr: /var/lib/ambari-agent/data/errors-35.txt
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py", line 81, in <module>
ZookeeperClient().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py", line 60, in install
self.install_packages(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 410, in install_packages
retry_count=agent_stack_retry_count)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package
self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 83, in checked_call_with_retries
return self._call_with_retries(cmd, is_checked=True, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 91, in _call_with_retries
code, out = func(cmd, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'zookeeper_2_4_*'' returned 1. Error: Nothing to do
stdout: /var/lib/ambari-agent/data/output-35.txt
2017-04-20 12:58:28,531 - Group['hadoop'] {}
2017-04-20 12:58:28,533 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-04-20 12:58:28,535 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-04-20 12:58:28,536 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-04-20 12:58:28,537 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-04-20 12:58:28,540 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2017-04-20 12:58:28,549 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2017-04-20 12:58:28,575 - Repository['HDP-2.4'] {'base_url': 'http://hdpserver.techmahindra.com/yum/HDP/centos6/2.x/updates/2.3.4.0', 'action': ['create'], 'components': ['HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP', 'mirror_list': None}
2017-04-20 12:58:28,585 - File['/etc/yum.repos.d/HDP.repo'] {'content': '[HDP-2.4]\nname=HDP-2.4\nbaseurl=http://hdpserver.techmahindra.com/yum/HDP/centos6/2.x/updates/2.3.4.0\n\npath=/\nenabled=1\ngpgcheck=0'}
2017-04-20 12:58:28,588 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://hdpserver.techmahindra.com/yum/HDP-UTILS-1.1.0.20/repos/centos6', 'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2017-04-20 12:58:28,594 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': '[HDP-UTILS-1.1.0.20]\nname=HDP-UTILS-1.1.0.20\nbaseurl=http://hdpserver.techmahindra.com/yum/HDP-UTILS-1.1.0.20/repos/centos6\n\npath=/\nenabled=1\ngpgcheck=0'}
2017-04-20 12:58:28,595 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-04-20 12:58:28,735 - Skipping installation of existing package unzip
2017-04-20 12:58:28,736 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-04-20 12:58:28,755 - Skipping installation of existing package curl
2017-04-20 12:58:28,756 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-04-20 12:58:28,765 - Skipping installation of existing package hdp-select
2017-04-20 12:58:28,983 - Package['zookeeper_2_4_*'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-04-20 12:58:29,126 - Installing package zookeeper_2_4_* ('/usr/bin/yum -d 0 -e 0 -y install 'zookeeper_2_4_*'') please help me to debug this issue. Thanks Pawan Giri
... View more
11-25-2016
11:42 AM
Well finally I solved this.
The "Connecting to namenode via http://<hostname>:50070/fsck?ugi=hdfs█s=1&files=1&locations=1&path=%2Fuser%2Fbigdata%2F.<directory>" is the stderr output of the command so redirecting stderr to /dev/null does the work :). for i in $(hadoop fs -ls /user/bigdata/ | grep drwx | awk '{print $8}'); do echo "$i $(hdfs fsck $i -blocks -files -locations 2> /dev/null | grep BP- | wc -l)" ; done
... View more
10-07-2016
06:55 AM
Thank you, it works perfectly
... View more
07-22-2016
12:37 AM
Hi @Juan Manuel Nieto, Generally /tmp directory mainly has temporary storage during MapReduce phases. Mapreduce adds the intermediate data that is kept under /tmp. These files will be automatically cleared out when Mapreduce job execution completes. Temporary files are also created by pig as it runs on Mapreduce phenomenon. Temporary files deletion happens at the end. Pig does not handle temporary files deletion if the script execution failed or killed. Then we have to handle the situation. This could be better handled by added the lines or changes in the script itself. For further details I found an article here: Hope that helps. Thanks, Sujitha
... View more
02-03-2016
07:30 PM
@Juan Manuel Nieto Thanks for the final followup!!
... View more
- « Previous
-
- 1
- 2
- Next »