Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2029 | 04-27-2020 03:48 AM | |
4020 | 04-26-2020 06:18 PM | |
3247 | 04-26-2020 06:05 PM | |
2599 | 04-13-2020 08:53 PM | |
3862 | 03-31-2020 02:10 AM |
01-30-2020
05:49 AM
1 Kudo
@mike_bronson7 Can you please try the following command to verify if Postgres is listening to * address and port is opened? # ps -ef | grep pgsql | grep ^postgres
# netstat -tnlpa | grep 5432
# netstat -tnlpa | grep $POSTGRES_PID If above does not show the port is listening properly then we might need to check the postgres logs. Next can you please check if the Following Test Postgres DB connection command is running without any issue on Ambari Server host? # /usr/jdk64/jdk1.8.0_112/bin/java -cp /var/lib/ambari-server/resources/DBConnectionVerification.jar:/usr/lib/ambari-server/postgresql-42.2.2.jar org.apache.ambari.server.DBConnectionVerification jdbc:postgresql://localhost:5432/ambari ambari bigdata org.postgresql.Driver The please try to run the same command using HOSTNAME of PostgresDB (instead of "localhost") # /usr/jdk64/jdk1.8.0_112/bin/java -cp /var/lib/ambari-server/resources/DBConnectionVerification.jar:/usr/lib/ambari-server/postgresql-42.2.2.jar org.apache.ambari.server.DBConnectionVerification jdbc:postgresql://localhost:5432/ambari ambari bigdata org.postgresql.Driver Please NOTE that the "/usr/lib/ambari-server/postgresql-42.2.2.jar" PATH and the JDK installation path might be different in your case so please update the command accordingly. . . Also as we see the message : REASON: Server not yet listening on http port 8080 after 50 seconds. Exiting. So it will be also good to try setting the following and then try to restart ambari again properto to a little high value like 120 or 150 seconds as sometimes ambari takes little longer time to start. Default value is 50 seconds. server.startup.web.timeout=150 .
... View more
01-30-2020
05:17 AM
1 Kudo
@dewi As we repeatedly see this WARNING: 2020-01-30T09:25:38,383 WARN [main]: metastore.RetryingMetaStoreClient (:()) - MetaStoreClient lost connection. Attempting to reconnect (10 of 24) after 5s. getCurrentNotificationEventId
org.apache.thrift.TApplicationException: Internal error processing get_current_notificationEventId Hence can you please try this to see if this works for you? Login to Ambari UI --> Hive --> Configs (Tab) --> Custom hive-site.xml Click on "Add" property button and then add the following property: hive.metastore.event.db.notification.api.auth=false Then restart HiveServer2 . . Also in your log we see the following ERROR: 2020-01-30T09:25:38,225 ERROR [json-metric-reporter]: metrics2.JsonFileMetricsReporter (:()) - Unable to rename temp file /tmp/hmetrics242742500630655243json to /tmp/report.json So can you lease check what ios the permission and ownership on the mentioned file? It should be owned and writable by "hive:hadoop" user. Example: # ls -lart /tmp/report.json
-rw-r--r--. 1 hive hadoop 3300 Jan 30 13:16 /tmp/report.json .
... View more
01-30-2020
05:02 AM
@AarifAkhter While setting up your maria DB have you performed the step mentioned in the doc as https://docs.cloudera.com/HDPDocuments/Ambari-2.5.2.0/bk_ambari-administration/content/using_ambari_with_mysql.html You must pre-load the Ambari database schema into your MySQL database using the schema script. Run the script in the same location where you find the Ambari-DDL-MySQL-CREATE.sql file. You should find the Ambari-DDL-MySQL-CREATE.sql file in the /var/lib/ambari-server/resources/ directory of the Ambari Server host, after you have installed Ambari Server. Ambari also shows this kind of message whenuser performs "ambari-server setup" while setting up the database. WARNING: Before starting Ambari Server, you must run the following DDL directly from the database shell to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql . Also please let us know if your MariaDB instance running on "localhost" Or on "ip-172-31-9-188.xxxxxxxxxxxxxxx.internal" Can you please change the "localhost" to the hostname of the DB. server.jdbc.hostname=ip-172-31-9-188.xxxxxxxxxxxxxxx.internal Also please verify if the "MariaDB" exist on the mariaDB running on host 'ip-172-31-9-188.xxxxxxxxxxxxxxx.internal' # mysql -u ambari -p
Enter password:
show databases; .
... View more
01-30-2020
04:32 AM
@AarifAkhter For MariaDB as well can you chose the --jdbc-db=mysql while setting up the Ambari DB. Or please update the ambari.properties to mysql where you might have selected as MariaDB server.jdbc.database=mysql https://github.com/apache/ambari/blob/branch-2.7/ambari-server/src/main/python/ambari_server/dbConfiguration.py#L49 Reference Doc: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/administering-ambari/content/amb_using_ambari_with_mysql_or_mariadb.html
... View more
01-30-2020
04:26 AM
@AarifAkhter Please check the below doc if you ahve specified the Maria DB type correctly as mentioned in the following doc: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/administering-ambari/content/amb_using_ambari_with_mysql_or_mariadb.html # ambari-server setup --jdbc-db=mysql --jdbc-driver=/path/to/mysql/mysql-connector-java.jar
... View more
01-30-2020
04:23 AM
@AarifAkhter Looks like you have not done the Database setup correctly thats the reason it is failing to determine the MariaDB settings com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown database 'MariaDB' Please share the exact ambari server version and the output of the following commands: # grep 'jdbc' /etc/ambari-server/conf/ambari.properties
# ambari-server --version . Have you setup the maria Db correctly? Is MariaDB supported version listed for your Ambari version in Support matrix? https://supportmatrix.hortonworks.com/
... View more
01-30-2020
04:12 AM
@AarifAkhter As you can see that ambari is saying that you may find more detailed cause of failure inside the logs : REASON: Ambari Server java process died with exitcode 1.
Check /var/log/ambari-server/ambari-server.out for more information. Can you please share the output of "/var/log/ambari-server/ambari-server.log" and "/var/log/ambari-server/ambari-server.out" file it will show some errors. Also please let us know if you are running ambari server as root user or non root user?
... View more
01-30-2020
03:45 AM
@dewi What do you mean by "I've tried setup hiveserver manually " ? Can you please share the details how you did this? Or have you used to setup Hive? Also can you please share the logs of HiveServer2 for it's Manual command line startup? Did you notice any error in the hiveserver2 log when you attempted to start it via command line ? If yes then can you please share the hive conf and full log ? (you can mask the passwords/hostname) . Also have you made any special config changes like hive.server2.support.dynamic.service.discovery? Have you disabled the "hive.server2.support.dynamic.service.discovery" setting in your "Advanced hive-site" ? It will be good to see the HS2 log and Hive Configs.
... View more
01-30-2020
03:34 AM
@dewi The problem does not look seem to be related to the Znode. Once the Hive Server2 is started successfully then you should see the znode. The issue seems to be the use of "localhost". As we see the following output in your output. Connection failed on host localhost:10000
.
.
beeline -n hive -u 'jdbc:hive2://localhost:10000/;transportMode=binary' Ideally those connection strings should be showing the FQDN (Fully Qualified Hostname) instead of showing "localhost". So please check if the Hive Server config is hardcoded with "localhost" address anywhere or if there is anything wrong with the hostname "/etc/hosts" ...etc # grep 'localhost' /etc/hive/conf/*.xml . Manual Startup Testing Also please verify if you are able to start the HiveServer2 using command line. As mentioned in # su - hive
# nohup /usr/hdp/current/hive-server2/bin/hiveserver2 -hiveconf hive.metastore.uris=/tmp/hiveserver2HD.out 2 /tmp/hiveserver2HD.log . Then check the port 10000 is listening to 0.0.0.0 OR localhost? # netstat -tnlpa | grep `cat /var/run/hive/hive-server.pid` . .
... View more
01-28-2020
12:11 PM
1 Kudo
@mike_bronson7 There are couple of other options we can explore like: Using HDFS command line is one of the best way to get the detailed version. # hdfs version Using HDP Select command on the host where you want to check the version. # hdp-select | grep hdfs-client Using Ambari API also we can get some idea about the hdfs client version shipped and installed as part of the HDP. # curl -s -u admin:admin -H "X-Requested-By: ambari" -X GET http://${AMBARI_SERVER_FQDN}:8080/api/v1/clusters/${CLUSTER_NAME}/hosts/${HOST_TO_CHECK}/host_components/HDFS_CLIENT | grep -i version . .
... View more