About smruti

smruti · ‎04-30-2024

@MorganMcEvoy We have two different issues here: 1. ClassNotFoundException: com.ctc.wstx.io.InputBootstrapper This seems to be due to an incompatible version of the client, where which is using some hadoop libraries that are not compatible with your version of Hive. 2. SunCertPathBuilderException: unable to find valid certification path to requested target This basically means, you need to specify the truststore file(that contains the root cert of the CA) in the connection string. In case the application you are using is equivalent to beeline, I think adding the following to the connection string should work: ;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=... SSL=1 might not work because it's is used with Cloudera and Apache JDBC driver. In case you have tried this already and it still fails, could you share the error message?

smruti · ‎04-11-2024

JDBC/ODBC Drivers for Hive can be downloaded from Cloudera website. The first thing we need to collect is the Hive Endpoint from Cloudera Management console. This can be found at the bottom of in the specific DataHub window. It will be in the following format: jdbc:hive2://datahub1-master0.geo-1035.lskx-pvue.a4.cloudera.site/;ssl=true;transportMode=http;httpPath=datahub1/cdp-proxy-api/hive Majorly we need to furnish the following information in the appropriate fields: Host(s) : datahub1-master0.geo-1035.lskx-pvue.a4.cloudera.site Port : 443 Authentication Mechanism : Username/Password Thrift Transport : HTTP Go to HTTP Options : HTTP Path : datahub1/cdp-proxy-api/hive (you will get this info from the Hive Endpoint) Go to SSL Options: 6.1. Check Enable SSL 6.2. Check Allow Self-signed Server Certificate check box 6.3. Trusted Certificates: Select the path to the PEM file containing the root ca cert of the Knox gateway. Note: You can download the TLS Public Certificate from Data Hub > Token Integration > TLS Public Certificate > Download the PEM file. Save and Test Connection.

smruti · ‎03-28-2024

@hegdemahendra You may try Cloudera Hive JDBC Driver. The driver class name would be "com.cloudera.hive.jdbc.HS2Driver".

smruti · ‎03-20-2024

@Choolake See if this does the job for you. ... ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.JsonSerde' WITH SERDEPROPERTIES ( 'separatorChar' = '|', 'quoteChar' = '"' ) STORED AS TEXTFILE LOCATION .... This is a third party serde. You may download it from https://code.google.com/archive/p/hive-json-serde/downloads

smruti · ‎03-20-2024

@ZainK This can happen due to various reasons such as resource constraints, or errors in the code. Do check those aspects.

smruti · ‎03-17-2024

@Hadoop16 Was it working before? Did anything change from Kerberos point of view? Try regenerating the hive keytab file and see if it helps.

smruti · ‎03-14-2024

Hive does use stats from an external table in preparing query plan. When stats are accurate, it could estimate the size of intermediate data sets and select efficient join strategies. The only thing I noticed is the fetch task is not working.

smruti · ‎03-14-2024

Try this: CREATE external TABLE mytable ( col1 INT, col2 STRING, col3 STRING, col4 STRING, col5 INT, col6 STRING, col7 STRING ... ) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde' WITH SERDEPROPERTIES ( "separatorChar" = ",", "quoteChar" = "\"" ) STORED AS TEXTFILE; It should work.

smruti · ‎03-12-2024

@yashwanth It seems like you want to separate columns based on the position of comma. In that case, you may create the table as follows: CREATE TABLE my_table ( col1 STRING, col2 INT, ... ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' ...

smruti · ‎03-12-2024

@Leopold It is disabled for external tables as data in HDFS can change without Hive knowing about it. Unfortunately I do not see a way to enforce fetch task for a query with an aggregate function.

Online	Offline
Last Visited	‎01-21-2026 01:27 AM

Member Since	‎10-28-2020 05:19 AM
Last Visited	‎01-21-2026 01:27 AM
Posts	623
Kudos received	46

Cloudera Community

Re: I have a HIVE table which contains JSON as a c...

Re: ANALYZE command not write data into hive metas...

Re: HBase stores base64 data when data is inserted...

Re: Deleting hive service on CDP Private Base and ...

Re: Not Able to run import command. it fails with ...

Re: Can't connect via JDBC to Hiveserver2 with Ker...

Connect to CDP DataHub Hive using Cloudera ODBC Dr...

Re: Any alternate for org.apache.hive:hive-jdbc ma...

Re: Table creation in HUE for JSON value

Re: Python connection on a hive 3 server

Re: Accessing Hive through Knox receiving HTTP 401...

Re: Hive query plan not using generated statistics

Re: how to load double quotes data of fields in hi...

Re: how to load double quotes data of fields in hi...

Re: Hive query plan not using generated statistics