Member since
12-12-2020
21
Posts
0
Kudos Received
0
Solutions
02-01-2023
07:06 AM
Hi Team, This is Prsanna. I'm new to CDP and trying to create a CDP Trail base cluster for testing purposes, but while creating it I'm facing an error in the Hive Service. Please suggest a possible solution. Please refer to the screenshot and log file. Log file: jar:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976/lib/hadoop-mapreduce/ranger-raz-intg-2.1.0.7.1.7.0-551.jar:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.2.14.jre7.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -n '' ]]
+ [[ create_metastore_tables == webhcat ]]
+ [[ create_metastore_tables == hiveserver2 ]]
+ [[ create_metastore_tables == updatelocation ]]
+ [[ create_metastore_tables == create_metastore_tables ]]
+ [[ -z /opt/cloudera/cm ]]
+ JDBC_JARS_CLASSPATH='/opt/cloudera/cm/lib/*:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.2.14.jre7.jar:/usr/share/java/oracle-connector-java.jar'
+ [[ create_metastore_tables == create_metastore_tables ]]
+ '[' 7 -ge 5 ']'
+ skip_if_tables_exist metastore_db_py.properties
+ '[' -z metastore_db_py.properties ']'
+ DB_INFO_FILENAME=metastore_db_py.properties
+ JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.2.14.jre7.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z /opt/cloudera/cm ]]
+ JDBC_JARS_CLASSPATH='/opt/cloudera/cm/lib/*:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.2.14.jre7.jar:/usr/share/java/oracle-connector-java.jar'
++ /usr/java/jdk1.8.0_232-cloudera/bin/java -Djava.net.preferIPv4Stack=true -cp '/opt/cloudera/cm/lib/*:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.2.14.jre7.jar:/usr/share/java/oracle-connector-java.jar' com.cloudera.cmf.service.hive.HiveMetastoreDbUtil /var/run/cloudera-scm-agent/process/1546335447-hive-metastore-create-tables/metastore_db_py.properties unused --printTableCount
Exception in thread "main" java.lang.RuntimeException: org.postgresql.util.PSQLException: The connection attempt failed.
at com.cloudera.cmf.service.hive.HiveMetastoreDbUtil.countTables(HiveMetastoreDbUtil.java:203)
at com.cloudera.cmf.service.hive.HiveMetastoreDbUtil.printTableCount(HiveMetastoreDbUtil.java:284)
at com.cloudera.cmf.service.hive.HiveMetastoreDbUtil.main(HiveMetastoreDbUtil.java:354)
Caused by: org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:297)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:217)
at org.postgresql.Driver.makeConnection(Driver.java:458)
at org.postgresql.Driver.connect(Driver.java:260)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at com.cloudera.enterprise.dbutil.SqlRunner.open(SqlRunner.java:193)
at com.cloudera.enterprise.dbutil.SqlRunner.getDatabaseName(SqlRunner.java:264)
at com.cloudera.cmf.service.hive.HiveMetastoreDbUtil.countTables(HiveMetastoreDbUtil.java:197)
... 2 more
Caused by: java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:607)
at org.postgresql.core.PGStream.<init>(PGStream.java:81)
at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:93)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:197)
... 11 more
+ NUM_TABLES='[ main] SqlRunner ERROR Error connecting to db with user '\''hive'\'' and jdbcUrl '\''jdbc:postgresql://gateway:7432/hive'\'''
+ [[ 1 -ne 0 ]]
+ echo 'Failed to count existing tables.'
+ exit 1
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
-
Cloudera
12-15-2020
09:55 AM
Hi @Kezia, Thanks for the solution, Thank you so much. It's working on CDH-6.3.1 version also. kudos.
... View more
12-14-2020
05:44 AM
Hi @tjangid , Thanks for your suggestion, I did the same way what you shared on link, I down loaded CSD jar file into /opt/cloudera/csd location, and I gave cloudera-scm:cloudera-scm permissions, after I restarted the clouders-scm-server.service, then after I login my cloudera page, and went to cloudera management service and restarted then after I went to parcels I checked configuration tab, here I find new parcel " http://archive.cloudera.com/csa/latest/parcels " but it not went to check for new parcels and it not showing any download parcel. I'm attaching screen shots please help me on this. I'm using cloudera-6.3.1 version. Thanks Prasanna
... View more
12-13-2020
05:58 AM
Hi Kezia, Thanks for your reply, I already followed that document, but in cdh5.16.2 and cdh6.3.1 there no option available for "Parcel Repositories & Network Settings tab" and HTTP authentication username override for Cloudera Repositories HTTP authentication password override for Cloudera Repositories and when I add csd jar file I gave Cloudera-scm user/group permissions and restarted the cloudera-scm-server, then after I restarted the C.M, and added the shown in the screenshot (because I download the CSA(CSD) parcel and I put the URL in configuration tab) parcel, but it not showing the "check for new parcels". please help me with this Thanks Prasanna
... View more
12-12-2020
08:58 PM
Hi, can you please tell me how to add the Flink Service to Cloudera. I can add the Parcel but it's not Distributing and shows service not available.Can you please help me on this. Thanks
... View more
Labels:
- Labels:
-
Apache Flink