Member since
12-11-2015
208
Posts
30
Kudos Received
31
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
85 | 01-02-2025 06:28 AM | |
618 | 08-14-2024 06:24 AM | |
1705 | 10-02-2023 06:26 AM | |
1461 | 07-28-2023 06:28 AM | |
9531 | 06-02-2023 06:06 AM |
03-10-2020
08:57 AM
This is much clear now On server side the request was rejected as the client was initiating non-ssl connection Caused by: org.apache.thrift.transport.TTransportException: javax.net.ssl.SSLException: Unrecognized SSL message, plaintext connection? Client side it was unable to trust the server certs as it was not configured to use a truststore Caused by: com.cloudera.hiveserver2.support.exceptions.GeneralException: [Cloudera][HiveJDBCDriver](500164) Error initialized or created transport for authentication: [Cloudera][HiveJDBCDriver](500169) Unable to connect to server: javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target. You got to add few more properties to your connection string jdbc:hive2://vdbdgw01dsy.dsone.3ds.com:10000/default;AuthMech=1;KrbAuthType=1;KrbHostFQDN=vdbdgw01dsy.dsone.3ds.com;KrbRealm=DSONE.3DS.COM;KrbServiceName=hive;LogLevel=6;LogPath=d:/TestPLPFolder/hivejdbclog;SSL=1;SSLTrustStore=<path_to_truststore>;SSLTrustStorePwd=<password to truststore>
If you dont have password to your truststore you can omit the parameter SSLTrustStorePwd
... View more
03-09-2020
10:02 PM
The SSH connection is established initially at the beginning of the action and the <command> tag executes the command passed within the tags, but it takes a while(~ around 3 hours) for the command to execute, and in the meantime this action gets updated to COMPLETED and proceeds on to the next subsequent action, whereas former command is still in execution phase. This exception arises when Oozie starts on the latter SSH action while the prior SSH action is still in execution. So why does Oozie presumes the prior SSH action as completed yet the command is still in process?
... View more
03-09-2020
08:34 AM
Have you considered creating a copy of the table as external (in new location you want) and then INSERT into NewTable SELECT * FROM OldTable?
... View more
03-06-2020
01:42 AM
Thanks Venkat!
... View more
03-04-2020
12:50 AM
That command worked a treat, I wasn't aware that the configuration xmls varied based on the purpose of the host they are deployed to. I've got the superuser running now, thanks for the help
... View more
03-03-2020
10:57 AM
Thanks @venkatsambath. It worked.
... View more
02-29-2020
06:58 AM
1 Kudo
Assuming you used the same certs, or even if you user different ones; you should be able to click the lock in any SSL based UIs (Ambari, Ranger, Nifi, yarn, grafana, etc) in your browser. This will show you all details of the certs including expiration dates.
... View more
02-27-2020
09:52 PM
This property is hive specific so it can be either enabled on hiveserver2 server level or in the client session level but is not possible to set on queue level (coz scheduler dont understand hive specific properties). If you set this property in hiveserver2 level - then all hive client will be mandated to use where clause when user run query on partitioned table. Other property which you can use is hive.metastore.limit.partition.request https://docs.cloudera.com/documentation/enterprise/5-14-x/topics/admin_hive_tuning.html Quoting from link Set the hive.metastore.limit.partition.request parameter to 1000 to limit the maximum number of partitions accessed from a single table in a query. See the Apache wiki for information about setting this parameter. If this parameter is set, queries that access more than 1000 partitions fail with the following error: MetaException: Number of partitions scanned (=%d) on table '%s' exceeds limit (=%d) Setting this parameter protects against bad workloads and identifies queries that need to be optimized. To resolve the failed queries: Apply the appropriate partition filters. Override the limit on a per-query basis. Increase the cluster-wide limit beyond 1000, if needed, but note that this adds memory pressure to HiveServer2 and the Hive metastore.
... View more
02-27-2020
06:38 PM
Thanks @venkatsambath & @EricL this would certainly help in my hadoop journey. Regards
... View more
02-26-2020
05:08 AM
Thanks @venkatsambath That helped. Regards, Ansar
... View more