Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2712 | 04-27-2020 03:48 AM | |
| 5270 | 04-26-2020 06:18 PM | |
| 4440 | 04-26-2020 06:05 PM | |
| 3563 | 04-13-2020 08:53 PM | |
| 5367 | 03-31-2020 02:10 AM |
04-11-2017
05:21 PM
2 Kudos
@Dinesh Chitlangia Following code might give the idea on what you are looking out for: https://github.com/apache/hadoop/blob/release-2.8.0-RC0/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/ApplicationId.java#L53-L58 /**
* <p><code>ApplicationId</code> represents the <em>globally unique</em>
* identifier for an application.</p>
*
* <p>The globally unique nature of the identifier is achieved by using the
* <em>cluster timestamp</em> i.e. start-time of the
* <code>ResourceManager</code> along with a monotonically increasing counter
* for the application.</p>
*/
@Public
@Unstable
public static ApplicationId newInstance(long clusterTimestamp, int id) {
ApplicationId appId = Records.newRecord(ApplicationId.class);
appId.setClusterTimestamp(clusterTimestamp);
appId.setId(id);
appId.build();
return appId;
} . According to the API, The ApplicationId represents the globally unique identifier for an application. The globally unique nature of the identifier is achieved by using the "cluster timestamp" i.e. The start-time of the "ResourceManager<"/code>" along with a monotonically increasing counter for the application. https://github.com/apache/hadoop/blob/release-2.8.0-RC0/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/util/Records.java#L35-L37 .
... View more
04-11-2017
02:39 PM
@Jose Johny If it is a fresh Sandbox import you have done on your VirtualBox then i will suggest you to please remove your sandbox and then freshly do the "VirtualBox --> File (Menu) --> Import Appliance" . If you can not do the above then please refer to the following article: https://community.hortonworks.com/articles/65914/how-to-add-ports-to-the-hdp-25-virtualbox-sandbox.html Specially the port unblock section to see if you have the ports properly unblocked. . Also please check the "VirtualBox -> Preferences -> Network (on the left menu bar)" Check if the "NAT" is configured properly or not.
... View more
04-11-2017
02:34 PM
@Mukesh Kumar - Login to your Ambari DB. For example postgres then: # psql -U ambari ambari
Password for user ambari: bigdata
- Then run the following queries to completely remove the Zookeeper service from DB. delete from hostcomponentstate where service_name = 'ZOOKEEPER';
delete from hostcomponentdesiredstate where service_name = 'ZOOKEEPER';
delete from servicecomponentdesiredstate where service_name = 'ZOOKEEPER';
delete from servicedesiredstate where service_name = 'ZOOKEEPER';
delete from alert_current where history_id in (select alert_id from alert_history where service_name = 'ZOOKEEPER');
delete from alert_notice where history_id in (select alert_id from alert_history where service_name = 'ZOOKEEPER');
delete from alert_history where service_name = 'ZOOKEEPER';
delete from alert_grouping where definition_id in (select definition_id from alert_definition where service_name = 'ZOOKEEPER');
delete from alert_history where alert_definition_id in (select definition_id from alert_definition where service_name = 'ZOOKEEPER');
delete from alert_current where definition_id in (select definition_id from alert_definition where service_name = 'ZOOKEEPER');
delete from alert_definition where service_name = 'ZOOKEEPER';
delete from alert_group_target where group_id in ( select group_id from alert_group where service_name = 'ZOOKEEPER');
delete from alert_group where service_name = 'ZOOKEEPER';
delete from serviceconfighosts where service_config_id in (select service_config_id from serviceconfig where service_name = 'ZOOKEEPER');
delete from serviceconfigmapping where service_config_id in (select service_config_id from serviceconfig where service_name = 'ZOOKEEPER');
delete from serviceconfig where service_name = 'ZOOKEEPER';
delete from requestresourcefilter where service_name = 'ZOOKEEPER';
delete from requestoperationlevel where service_name = 'ZOOKEEPER';
delete from clusterservices where service_name ='ZOOKEEPER';
delete from clusterconfig where type_name like 'zookeeper%';
delete from clusterconfigmapping where type_name like 'zookeeper%';
- Now restart ambari server: # ambari-server restart . Additionally the 500 error for the API call "POST method for API: /api/v1/stacks/HDP/versions/2.5/recommendations." indicates a DB inconsistency. So if it is a fresh cluster then or if you do not want to have any service installed to is and move to the very initial state of ambari installation then better to perform an ambari reset instead of deleting services from ambari UI (As we see you only have zookeeper installed there) # ambari-server reset . *NOTE:* It is always recommended to keep a DB dump as a backup before making any manual DB changes.
... View more
04-11-2017
10:10 AM
@Nilesh You can find the Zip files in the : http://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-installation/content/ambari_repositories.html . Those Tar ball mentioned in the above link contains the offline repository for ambari. You should find the RPMs in these files. Example: (CentOs6 ambari tarball) http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.5.0.3/ambari-2.5.0.3-centos6.tar.gz
... View more
04-10-2017
11:43 AM
@zkfs By any chance are you using LDAP or Active Directory authentication? If yes, then when you are getting the "Error validating the login (state=08S01,code=0)" on the "beeline" side please check the Hiveserver2 logs of the same timestamp you will definitely find the detail of the login failure. Please share the hiveserver log if you find anything strange.
... View more
04-10-2017
11:40 AM
@zkfs Can you also try specifying the Port as well Like: # beeline -u "jdbc:hive2://erie3.example.com:10000/default;" -n user . Also in your case we see that the reason of failure is "Error validating the login (state=08S01,code=0)" Seems login validation related. What is the credential of user "-n user" here ? Are you passing value like:
# beeline --help | grep password
-p <password> the password to connect as
-w (or) --password-file <password file> the password file to read password from
.
... View more
04-09-2017
02:03 PM
@Yermek Kkk @Yermek Kkk 1.
According to Support metrics you should be using 64-bit operating
system instead of 32-bit. You have mentioned that you are using "CentOS
release 6.6 (32 bit)". http://dev.hortonworks.com.s3.amazonaws.com/HDPDocuments/HDP2/HDP-2.5.0/bk_release-notes/content/ch01s02s01.html 2. Please check if your remote repository is configured properly or not? (for 64 bit) # yum clean all
# yum repolist
# yum whatprovides hadoop
# yum whatprovides hadoop-yarn . The yum whatprovides
output should show the repository in which the mentioned package is
available. If it does not show anything then it means your remote
repository setup is not correct. In that case try using the Hortonworks
repository directly or fix your remote repository.
... View more
04-09-2017
02:03 PM
@Yermek Kkk 1. According to Support metrics you should be using 64-bit operating system instead of 32-bit. You have mentioned that you are using "CentOS release 6.6 (32 bit)". http://dev.hortonworks.com.s3.amazonaws.com/HDPDocuments/HDP2/HDP-2.5.0/bk_release-notes/content/ch01s02s01.html 2. Please check if your remote repository is configured properly or not? (for 64 bit) # yum clean all
# yum repolist
# yum whatprovides hadoop
# yum whatprovides hadoop-yarn . The yum whatprovides output should show the repository in which the mentioned package is available. If it does not show anything then it means your remote repository setup is not correct. In that case try using the Hortonworks repository directly or fix your remote repository.
... View more
04-08-2017
08:44 AM
@darkz yu Any service configuration changes that we make from Ambari UI, takes effect only when we restart those effected service components or clients/agents. During the restart the new configuration changes are pushed to the service components or clients/agents . Refresh Configuration also does the same thing (restarts the affected components)
... View more
04-07-2017
06:28 PM
@Shigeru Takehara
If you want to make any changes in the Zeppelin memory settings then you can login to ambari UI and the navigate to
"Zeppelin Notebook" --> "Configs" (Tab) --> "Advanced zeppelin-env" 'and then find the "zeppelin_env_content" there you will find "export ZEPPELIN_MEM" that you can edit.
... View more