Member since
03-01-2018
14
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4749 | 04-17-2019 06:38 AM |
10-04-2019
05:34 PM
thanks Eric, this fixed the issue 🙂
... View more
10-04-2019
12:51 AM
@EricL Thank you for your help. when adding the single quote i got a different errors [root@slave1 ~]# beeline -u 'jdbc:hive2://slave1:10000;ssl=true;sslTrustStore=/var/run/cloudera-scm-agent/process/72-hive-HIVESERVER2/cm-auto-host_keystore.jks;trustStorePassword=yeap4IhJzRvK5gBGVMeTahoL21BNmBF2TSi46pbQTP6' WARNING: Use "yarn jar" to launch YARN applications. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2://slave1:10000;ssl=true;sslTrustStore=/var/run/cloudera-scm-agent/process/72-hive-HIVESERVER2/cm-auto-host_keystore.jks;trustStorePassword=yeap4IhJzRvK5gBGVMeTahoL21BNmBF2TSi46pbQTP6 Error: Bad URL format. Hostname not found in authority part of the url: slave1:10000;ssl=true;sslTrustStore=. Are you missing a '/' after the hostname ? (state=,code=0) Beeline version 2.1.1-cdh6.2.1 by Apache Hive beeline> if i added the / , i got different error [root@slave1 ~]# beeline -u 'jdbc:hive2://slave1/:10000;ssl=true;sslTrustStore=/var/run/cloudera-scm-agent/process/72-hive-HIVESERVER2/cm-auto-host_keystore.jks;trustStorePassword=yeap4IhJzRvK5gBGVMeTahoL21BNmBF2TSi46pbQTP6' WARNING: Use "yarn jar" to launch YARN applications. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2://slave1/:10000;ssl=true;sslTrustStore=/var/run/cloudera-scm-agent/process/72-hive-HIVESERVER2/cm-auto-host_keystore.jks;trustStorePassword=yeap4IhJzRvK5gBGVMeTahoL21BNmBF2TSi46pbQTP6 19/10/04 07:48:03 [main]: WARN jdbc.HiveConnection: Failed to connect to slave1:-1 Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport with JDBC Uri: jdbc:hive2://slave1:-1/:10000;ssl=true;sslTrustStore=/var/run/cloudera-scm-agent/process/72-hive-HIVESERVER2/cm-auto-host_keystore.jks;trustStorePassword=yeap4IhJzRvK5gBGVMeTahoL21BNmBF2TSi46pbQTP6: Error creating the transport (state=08S01,code=0) Beeline version 2.1.1-cdh6.2.1 by Apache Hive beeline> i do not have domain name in this setup [root@slave1 ~]# hostname slave1 [root@slave1 ~]# hostname -a [root@slave1 ~]# Appreciate your help
... View more
10-03-2019
12:10 PM
Hi Experts, we setup Cloudera cluster on to verify the performance Cloudera was installed with Auto-TLS enabled and we are facing issues to connect to hive. [root@slave1 agent-cert]# beeline -u jdbc:hive2://slave1:10000;ssl=true;sslTrustStore=/var/run/cloudera-scm-agent/process/72-hive-HIVESERVER2/cm-auto-host_keystore.jks;trustStorePassword=yeap4IhJzRvK5gBGVMeTahoL21BNmBF2TSi46pbQTP6 WARNING: Use "yarn jar" to launch YARN applications. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2://slave1:10000 19/10/03 18:54:16 [main]: WARN jdbc.HiveConnection: Failed to connect to slave1:10000 Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport with JDBC Uri: jdbc:hive2://slave1:10000: Invalid status 21 (state=08S01,code=0) Beeline version 2.1.1-cdh6.2.1 by Apache Hive beeline> also standard format fails: [root@slave1 agent-cert]# beeline -u jdbc:hive2://slave1:10000 WARNING: Use "yarn jar" to launch YARN applications. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2://slave1:10000 19/10/03 19:07:50 [main]: WARN jdbc.HiveConnection: Failed to connect to slave1:10000 Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport with JDBC Uri: jdbc:hive2://slave1:10000: Invalid status 21 (state=08S01,code=0) Beeline version 2.1.1-cdh6.2.1 by Apache Hive beeline> we were not sure about the trustStorePassword so we used what is included in: [root@slave1 agent-cert]# cat /var/lib/cloudera-scm-agent/agent-cert/cm-auto-host_key.pw yeap4IhJzRvK5gBGVMeTahoL21BNmBF2TSi46pbQTP6 [root@slave1 agent-cert]# We were try to connect following: https://docs.cloudera.com/documentation/enterprise/5-6-x/topics/sg_hive_encryption.html#concept_rqh_sff_cm But not sure what is need to be fixed , appreciate your help please Thanks
... View more
Labels:
- Labels:
-
Apache Hive
04-17-2019
06:38 AM
2 Kudos
I fixed the issue by making both hostname & hostname -f returning the same value. then uninstalled cloudera manger & agents then rerun the certmanager /opt/cloudera/cm-agent/bin/certmanager --location /opt/cloudera/CMCA setup --configure-services All went fine afterwards thanks for all help
... View more
04-15-2019
12:18 PM
Hello, I am trying to install CDH with cloudera manger 6.2 on 2 goodgle cloud VM instances when creating the cluster it downloaded CDH 6.2.0-1.cdh6.2.0.p0.967373 sucessfully but then it is not doing any distrubution and just hang there firewall is disable , SELinux is disabled i can login with ssh and copy with scp between both VMs normal when checking the agent log File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/M2Crypto/SSL/Checker.py", line 125, in __call__ fieldName='subjectAltName') WrongHost: Peer certificate subjectAltName does not match host, expected mugzy.c.essential-rider-208218.internal, got DNS:mugzy and here is hostname: [root@mugzy ~]# python -c "import socket; hostname = socket.gethostname(); print hostname;" mugzy [root@mugzy ~]# Appreciate your insight
... View more
Labels:
- Labels:
-
Cloudera Manager
04-16-2018
11:33 AM
Hello,
I am using CDH 5.14, on VirtualBox with 10Gb memory 2 nodes cluster.
I wanted to test the hive functionality so i set the nodemanager memory to 2.6G.
Created hive table with 8000 rows in text format.
when i try to count the rows through hive it did not progress as follows, can you please give some hints:
hive> select count(*) from geo; Query ID = hdfs_20180416185858_a1bbf6cb-0d82-4682-90ef-0ef49a5d1777 Total jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=<number> In order to limit the maximum number of reducers: set hive.exec.reducers.max=<number> In order to set a constant number of reducers: set mapreduce.job.reduces=<number> Starting Job = job_1523896483209_0002, Tracking URL = http://mugzy:8088/proxy/application_1523896483209_0002/ Kill Command = /opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/bin/hadoop job -kill job_1523896483209_0002 Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1 2018-04-16 18:58:33,289 Stage-1 map = 0%, reduce = 0% 2018-04-16 18:59:34,122 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:00:34,879 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:01:35,630 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:02:36,494 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:03:37,172 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:04:38,043 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:05:38,688 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:06:39,323 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:07:39,982 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:08:40,803 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:09:41,456 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:10:42,092 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:11:42,703 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:12:43,467 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:13:44,131 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:14:44,947 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:15:45,599 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:16:46,176 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:17:46,985 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:18:47,587 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:19:48,280 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:20:48,978 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:21:49,626 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:22:50,375 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:23:51,002 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:24:51,622 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:25:52,227 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:26:52,789 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:27:53,365 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:28:53,978 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:29:54,747 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:30:55,495 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:31:56,171 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:32:56,910 Stage-1 map = 0%, reduce = 0% 2018-04-16 19:33:57,642 Stage-1 map = 0%, reduce = 0%
... View more
Labels:
- Labels:
-
Apache Hive
-
HDFS
-
MapReduce
03-07-2018
07:34 AM
thanks for explantion
... View more
03-07-2018
01:09 AM
Thank you Ihebert below are all installed instances: Alert Publisher Started cloudera Commissioned Alert Publisher Default Group Event Server Started cloudera Commissioned Event Server Default Group Host Monitor Started cloudera Commissioned Host Monitor Default Group Reports Manager Started cloudera Commissioned Reports Manager Default Group Service Monitor Started cloudera Commissioned Service Monitor Default Group i have been prompt only to enter info for Reports Manager database, is that normal giving the above listed instances please ?
... View more
03-06-2018
03:27 AM
1 Kudo
Hello,
I am installing clouderal manager 5.14 with MySQL as external database.
althought the documentation mention to create diffeenent datbases to host the cloudera manager managment components data as explained here:
https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_mysql.html#cmig_topic_5_5
Activity Monitor
amon
amon
amon_password
Reports Manager
rman
rman
rman_password
i choosed custom intsllation to only install the HDFS and YARN
When i did the installation i have only been requested to enter the Reports Mnager database info
I have not been requested to enter data for activity monitor which i believe part of the cloudera manager itself
Appreciate your advise
... View more
Labels:
- Labels:
-
Apache YARN
-
Cloudera Manager
-
HDFS
03-01-2018
08:13 AM
Hello, I am following Viewing and Reverting Configuration Changes https://www.cloudera.com/documentation/enterprise/latest/topics/cm_mc_revert_configs.html But i can not see History and Rollback button anywhere Appreciate if you share sceenshot of directions where this button is located please
... View more
Labels:
- Labels:
-
Cloudera Manager
-
Quickstart VM