Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2448 | 04-27-2020 03:48 AM | |
4885 | 04-26-2020 06:18 PM | |
3976 | 04-26-2020 06:05 PM | |
3220 | 04-13-2020 08:53 PM | |
4926 | 03-31-2020 02:10 AM |
02-22-2017
06:40 AM
@Aruna Sameera
The first error that you got you can ignroe it. Because inside "hive>" shll if you will run that command "hive shell;" then you will get the same error. Because "hive shell" is a command to start the hive shell, But once you are inside the hive shell then there is no such command "hive> hive shell".
... View more
02-22-2017
06:16 AM
@Aruna Sameera Do you see any output of the following? To see if the "recharge" table of "telecom" database has any data or not? # hive shell
hive> use telecom;
hive> select * from recharge;
If you see no records then please insert some records there. .
... View more
02-22-2017
05:56 AM
@Aruna Sameera
You will find the value of "hive.metastore.warehouse.dir" parameter in the "hive-site.xml" .
Can you please share what value do you have there for this parameter?
... View more
02-22-2017
05:40 AM
@Aruna Sameera Can you please check what value have you set for the "hive.metastore.warehouse.dir" ? In my cluster it is : "/apps/hive/warehouse" in my HDP based hive configs.
... View more
02-22-2017
04:25 AM
@Sonny Heer
Unfortunately this feature is available since Ambari 2.4 onwards. Is there any possibility for you to try upgrading to ambari 2.4 it has lots of improvements in terms of Views, also has a lots of bug fixes and new features to make things more easy. Upgrading to ambari 2.4 will be quite easy though.
... View more
02-22-2017
04:04 AM
@Sonny Heer I have written a very simple article on this feature for enabling HTTPs you can refer to the same as well: https://community.hortonworks.com/articles/84861/how-to-generate-the-ambaris-setup-security-options.html - I would suggest you to use the "ambari-server --help" to get more information about those arguments, there might be slight changes in the argument names.
... View more
02-22-2017
04:02 AM
3 Kudos
In this article we will talk about one of the best feature of Ambari 2.4 in which we will be doing the ambari "setup-security" in non interactive mode to enable the HTTPs in ambari server.
I assume that you have alredy created the ambari-server keys and certificate using open ssl. So we will see how can we do the HTTPs setup using a single line command: ambari-server setup-security --security-option=setup-https --api-ssl=true --api-ssl-port=8443 --import-cert-path=/etc/ambari-server/certs/sandbox.hortonworks.com.crt --import-key-path=/etc/ambari-server/certs/sandbox.hortonworks.com.key --pem-password=hadoop Output of the above command can be as following, Notice that it will run in non interactive mode. Using python /usr/bin/python
Security setup options...
Do you want to configure HTTPS [y/n] (y)?
SSL port [8443] ?
Please enter password for Private Key:
Importing and saving Certificate...done.
Ambari server URL changed. To make use of the Tez View in Ambari please update the property tez.tez-ui.history-url.base in tez-site
Adjusting ambari-server permissions and ownership...
NOTE: Restart Ambari Server to apply changes ("ambari-server restart|stop+start") . Now in order to see the configuration changes we will need to restart ambari server. ambari-server restart Now we can simply access ambari server using the HTTPs port 8443 as following: https://localhost:8443/#/main/dashboard/metrics
. - This feature in ambari is added as part of JIRA: Ability to automate setup-security and setup-ldap/sync-ldap: https://issues.apache.org/jira/browse/AMBARI-14627
- We can see similar examples there (there might be little changes in the argument names though) so use the "ambari-server --help" to explore those arguments. Examples from AMBARI-14627, I have not tested the following options so you might see some small argumant changes there in the actual implementations: 1.) LDAP setup:
ambari-server setup-ldap --ldap-url="ldap.apache.org389" --ldap-secondary-url="" --ldap-ssl="false" --ldap-user-class="person" --ldap-user-attr="sAMAccountName" --ldap-group-class="group" --ldap-group-attr="cn" --ldap-member-attr="member" --ldap-dn="distunguishedName" --ldap-base-dn="dc=ambari01,dc=local" --ldap-referral="" --ldap-bind-anonym=false --ldap-manager-dn="cn=hdfs,ou=ambari,dc=ambari01,dc=local" --ldap-manager-password="myldappassword" --ldap-save-settings --truststore-type="jks" --truststore-path="/var/lib/ambari-server/keys/jkskeystore.jks" --truststore-password="mypass"
2.) Ldap sync:
ambari-server sync-ldap --groups=groups.txt --ldap-sync-admin-name=admin --ldap-sync-admin-password=admin
3.) Setup Https:
ambari-server setup-security \
--security-option=setup-https --api-ssl=true --client-api-ssl-port=8443 \
--import-cert-path=/var/lib/ambari-server/keys/my.crt \
--import-key-path=/var/lib/ambari-server/keys/my.key --pem-password=password
4.) Encrypt passwords:
ambari-server setup-security --security-option=encrypt-passwords --master-key=masterkey --master-key-persist=true
5.) Setup Kerberos JAAS:
ambari-server setup-security --security-option=setup-kerberos-jaas --jaas-principal="ambari@EXAMPLE.COM" --jaas-keytab="/etc/security/keytabs/ambari.keytab"
6.) Setup TrustStore:
ambari-server setup-security --security-option=setup-truststore \
--truststore-path=/var/lib/ambari-server/keys/keystore.p12 --truststore-type=pkcs12 \
--truststore-password=password --truststore-reconfigure
7.) Import certificate to TrustStore:
ambari-server setup-security \
--security-option=import-certificate \
--truststore-path=/var/lib/ambari-server/keys/keystore.p12 \
--truststore-type=pkcs12 \
--truststore-password=password \
--import-cert-path=/var/lib/ambari-server/my.crt \
--import-cert-alias=myalias \
--truststore-reconfigure . .
... View more
Labels:
02-22-2017
03:34 AM
@Sonny Heer If you are using Ambari 2.4 then you can use the automated way to setup security as mentioned in: https://issues.apache.org/jira/browse/AMBARI-14627 Example: ambari-server setup-security --security-option=encrypt-passwords --master-key=masterkey --master-key-persist=true .
... View more
02-22-2017
03:27 AM
@Adeel Hashmi Have you already placed the "json-serde-*.jar" jar into folder "/usr/hdp/current/hive-client/auxlib" (in each hiveserver2/hive cli node) ? Also you should create an "auxlib" folder as following in the hive installation and put all jars that are needed in there. These are then available to the Server and the executed tez jobs. . mkdir /usr/hdp/current/hive/auxlib
cp -f /tmp/json-serde-*.jar /usr/hdp/current/hive/auxlib .
... View more
02-22-2017
03:12 AM
@Oriane
Wonderful and good to know that the mentioned link helped you to fix the issue.
It will be really great if you mark this thread as Answer "Accepted" that way it will be useful for other users as well.
... View more