Member since
01-19-2017
3679
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 828 | 06-04-2025 11:36 PM | |
| 1412 | 03-23-2025 05:23 AM | |
| 702 | 03-17-2025 10:18 AM | |
| 2516 | 03-05-2025 01:34 PM | |
| 1645 | 03-03-2025 01:09 PM |
10-17-2017
09:33 AM
@ilia kheifets Hive needs a metastore database to store structure information of the various tables and partitions in the warehouse. Oozie stores the workflow/scheduler details in the relational database You could use postgres instead of Mysql and the creation is even easier see below Hive database In the below example the database and user is "hive" # su - postgres
postgres@ubuntu17:~$ psql
psql (9.5.9)
Type "help" for help.
postgres=# DROP DATABASE if exists hive;
postgres=# CREATE USER hive PASSWORD 'hive';
postgres=# CREATE DATABASE hive OWNER hive;
postgres=# grant all privileges on database hive to hive;
postgres=# \q Oozie database In the below example the database and user is "oozie" postgres=# DROP DATABASE if exists oozie;
postgres=# CREATE USER oozie PASSWORD 'oozie';
postgres=# CREATE DATABASE oozie OWNER oozie;
postgres=# grant all privileges on database oozie to oozie;
postgres=# \q After the above has been successful during the Ambari UI setup use the hive and oozie info to set up these components. Can you let me know if the installation succeeded
... View more
10-17-2017
06:45 AM
@Kumar Peddibhotla Good I will wait for your feedback, the output of my REALM is just an example placeholder and for sure it won't match yours but the methodology is the same
... View more
10-16-2017
08:00 PM
@Kumar Peddibhotla You need to go through this druid setup in a kerberized environment if you haven't yet done so Druid-Kerberos. After kerberisation check whether druid keytab was generated in /etc/security/keytabs/druid.keytab. If so then you will need to kinit the /etc/security/keytabs/druid.keytab. with the correct principal which you can obtain by running # klist -kt /etc/security/keytabs/druid.keytab The output could be something like this $ klist -kt /etc/security/keytabs/druid.keytab
Keytab name: FILE:/etc/security/keytabs/druid.keytab
KVNO Timestamp Principal
---- ----------------- -------------------------------
1 02/02/17 23:00:12 druid/FQDN@REALM
1 02/02/17 23:00:12 druid/FQDN@REALM To get a valid Kerberos ticket you will need to kinit kt $keytab $ principal $ kinit -kt /etc/security/keytabs/druid.keytab druid/FQDN@REALM Now the errors should disappear, please let me know if that helped
... View more
10-16-2017
11:48 AM
@subhash parise On the offending node, do the following, bizzare thee are no files in /var/lib/ambari-agent/data: Stop and remove ambari-agent ambari-agent stop
yum erase ambari-agent
rm -rf /var/lib/ambari-agent
rm -rf /var/run/ambari-agent
rm -rf /usr/lib/amrbari-agent
rm -rf /etc/ambari-agent
rm -rf /var/log/ambari-agent
rm -rf /usr/lib/python2.6/site-packages/ambari* Re-install the Ambari Agent yum install ambari-agent
vi /etc/ambari-agent/conf/ambari-agent.ini Change hostname to Ambari Server [server]
hostname={Ambari-server_host_FQDN}
url_port=8440
secured_url_port=8441
connect_retry_delay=10
max_reconnect_retry_delay=30 Restart the agent ambari-agent start That should resolve the issue
... View more
10-16-2017
11:30 AM
@raouia What were the components on the deleted host? I don't quite understand "My cluster was composed of an ambari-server and 2 ambari-agents. I removed one node from ambari agents." Do you mean it was a 3 node cluster (1 master and 2 slaves) if so how was the component distributed? I am more concerned about the delete host?
... View more
10-16-2017
10:56 AM
@subhash parise Your Ambari is SSL enabled did you by chance also enable 2 ways SSL between Ambari Server and Ambari Agents? see doc Here is a HCC document that can also help you achieve that. Enable 2 way SSL between Ambari-Server and Ambari-agents in Ambari 2.5 Hope that helps
... View more
10-16-2017
10:49 AM
@raouia Could you attach the zookeeper logs in /var/log/zookeeper? You mean the zookeeper was running before did you restart it , that's when you realised it could start? Did you make any config changes through Ambari or not? Is it possible to get a longer stack trace of the error.png? Because the interesting part is missing.
... View more
10-16-2017
10:38 AM
@ilia kheifets I am positive it will work! And once it does don't forget to accept my answer. That way other HCC users can quickly find the solution when they encounter the same issue. Please let me know
... View more
10-16-2017
09:06 AM
@ilia kheifets Here we go all the services up and running without major issues !!! Did you install java with JCE? standard procedure? I have seen your comments but at times we ignore the obvious well-documented steps. I followed usual steps and all is up and running. As I have demonstrated that the procedure is OK and valid, this answered your question.
... View more
10-15-2017
09:11 PM
@Neha G If you have sudo privileges just do this you will need a valid kerberos ticket just realised you have a kerberized cluster $sudo su - hdfs List the correct principal for hdfs $ klist -kt /etc/security/keytabs/hdfs.headless.keytab Keytab name: FILE:/etc/security/keytabs/hdfs.headless.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 1 08/24/2017 15:42:23 hdfs-cluster@YOUR_REALM Then grab a valid kerbero ticket $ kinit -kt /etc/security/keytabs/hdfs.headless.keytab hdfs-cluster@YOUR_REALM Then $ hdfs dfsadmin -safemode leave That should work now !
... View more