Member since
08-23-2018
36
Posts
1
Kudos Received
0
Solutions
01-21-2021
02:35 AM
The java heap size of the catalog server in my cluster is 16G. Mem_rss metric of impala catalogd is 15G. What is the mem_rss metric of impala catalogd? If the mem_rss metric is high, should I increase the Java heap size? Version is CDH 5.14
... View more
Labels:
- Labels:
-
Apache Impala
11-17-2020
05:21 PM
Thanks to your answer. I have read documents in your answer. How cat I disable Self-Signed Certificate verify? Like this : [hadoop]
[[hdfs_clusters]]
[[[default]]]
ssl_cert_ca_verify=False
[[yarn_clusters]]
[[[default]]]
ssl_cert_ca_verify=False
... View more
11-16-2020
10:54 PM
When I click impala query profile, Hue raise error. Exception cause Self-signed certificate. I am finding the solution. bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)" Current configuration in my cluster : Impala : Enable TLS/SSL for Impala : disabled
SSL/TLS Certificate for Impala component Webserver : Daemon, Catalog, Statestore enabled I want to set PEM file path. Where are Hue - [Impala] - [[ssl]] properties used?
... View more
Labels:
- Labels:
-
Cloudera Hue
11-15-2020
05:48 PM
Questions about how to configurate Hue Configuring TLS/SSL for Impala [impala]
# Port of the Impala Server
## server_port=21050
# URL of the Impala Coordinator Server.
## coordinator_url=localhost:25000
[[ssl]]
# SSL communication enabled for this server.
## enabled=false
# Path to Certificate Authority certificates.
## cacerts=/etc/hue/cacerts.pem
# Choose whether Hue should validate certificates received from the server.
## validate=true Do Imapala TLS/SSL settings in Hue apply to both 21050 and 25000 communications? Impala in my cluster, Only 'SSL/TLS Certificate for Impala component Webserver' is configured. https://docs.cloudera.com/documentation/enterprise/5-14-x/topics/impala_ssl.html#concept_gnk_2tt_qp Port 25000 uses SSL. Port 21050 does not use SSL. Would the connection to port 21050 fail If I set ssl for Imapala in hue. When I click impala query profile, Hue raise error. I am finding the solution. bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)"
... View more
Labels:
- Labels:
-
Apache Impala
-
Cloudera Hue
12-09-2019
05:11 PM
Thank for the answer.
... View more
12-09-2019
03:02 AM
https://docs.cloudera.com/documentation/enterprise/6/6.1/topics/admin_ha_hiveserver2.html#concept_u4b_c5d_wv My cluster version is Cloudera CDH 6.1 Express Edition. I try set Hive HA. I added new instance. And I set the address on HiveServer2 Load Balancer property. But Load Balancer server didn't open proxy port. Doesn't Managed cluster start proxy server? Do I have to configure proxy? Managed cluster means Enterprise Edition? If that is, Can I use L4 instead of haproxy?
... View more
Labels:
- Labels:
-
Apache Hive
11-06-2019
10:13 PM
Thanks. However, I have already read them. I'am already connecting to Hive from Zeppelin using JDBC. I want to query Hive Table with SparkSQL. And I'm wondering if the metastore won't crash if I use it in a Cluster using HiveOnSpark. For example. %spark
val df = spark.read.format("csv").option("header", "true")
.option("inferSchema", "true").load("/somefile.csv")
df.createOrReplaceTempView("csvTable");
%spark.sql
select *
from csvTable lt
join hiveTable rt
on lt.col = rt.col
... View more
11-05-2019
10:32 PM
I am using CDH 6.1.1 Cluster. Cluster is configured to use Spark as the execution engine for Hive. Is there anything wrong with using SparkSQL on this Cluster? Is it ok to create Hive Tables and change data using SparkSQL? Since SparkSQL uses the Hive Metastore, I suspect that there may be a conflict between SparkSQL and Hive on Spark. In addition, please refer to documentation on how to intergrate Cloudera CDH Hive with Apache Zeppelin's Spark interpreter. Thank you.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
-
Apache Zeppelin
08-04-2019
09:01 PM
Thanks. I did find the solution. The reason was relate impala compute. I have been update avro schema 'extras' field. I have been execute 'impala compute' command. Maybe reason is that. I did drop table my external table, And create table. It is working.
... View more
08-04-2019
08:54 PM
1 Kudo
Thanks you. Yes, It is not problem of UDF. I have 2 HiveServer2 server host. I have been register udf only 1 server host. Maybe. It is reason.
... View more