Member since
04-11-2017
5
Posts
0
Kudos Received
0
Solutions
06-12-2017
03:24 PM
@amarnath reddy pappu @mqureshi, @Kuldeep Kulkarni, @Gerd Koenig, @Andrew Ryansmaple-mapreduce-job-error.txtmapreduce-error-in-hive-wiht-beeline.txt
We have enabled SSL/TLS on HDP cluster by following @amarnath reddy pappu blog :
https://community.hortonworks.com/articles/52875/enable-https-for-hdfs.html and HDP documentation.
Almost all service opening on Https defined port. But Only issue we are currently facing is : MAP
REDUCE JOBS ARE NOT LAUNCHING
We use hive through beeline connector. While executing query we receive error :
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. java.lang.RuntimeException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty (state=08S01,code=1) Tried a Sample Map reduce Job alone as well. That also got failed. Error is long so attaching here.
I would appreciate your help. 🙂
... View more
05-11-2017
11:37 PM
Its pleasure to receive your reply. I have applied the SSL on all the service mentioned in your posts on my cluster. Now just receiving few service related issues after enabling SSL.
One of them is, we are not able to run a Hive map reduce job after enabling SSL.
I am currently investigating
below mentioned issue in which we are not able to execute MR jobs. After
enabling SSL, they are getting error
javax.net.ssl.SSLException: java.lang.RuntimeException:
Unexpected error: java.security.InvalidAlgorithmParameterException: the
trustAnchors parameter must be non-empty.
Can you give me some solution for this ?
... View more
04-14-2017
10:26 AM
Hi pappu , I have followed the same steps you mentioned for enabling HTTPS(SSL) on my Sandbox HDFS. I am pretty sure every thing is matched to your instructions. But I am not able to access my sandbox hdfs on https (port:50470). I am using self signed cert for keystore. Can you kindly help me out for this ? Answer few questions : 1) Does the case with sandbox is different as compared to real time cluster ?
2) Does there any thing need to be done in host system (OS) ?
3) Does any user permissions need to be set on the certificates folder and files? I have folder owner:group as hdfs:hadoop , given permission 700 to folder and 600 to files. After setting up all cluster service remains up. But https access does not get success.
Help will be appreciated. Thanks
... View more
04-14-2017
08:17 AM
Hi pappu ,
I have followed the same steps you mentioned for enabling HTTPS(SSL) on my Sandbox HDFS. I am pretty sure every thing is matched to your instructions. But I am not able to access my sandbox hdfs on https (port:50470). I am using self signed cert for keystore. Can you kindly help me out for this ?
Answer few questions :
1) Do the case with sandbox is different as compared to real time cluster ?
2) Does there any thing need to be done in host system (OS) ?
3) Does any user permissions need to be set on the certificates folder and files ? I have set 700 for folder and 600 for keystore file. I have set hdfs:hadoop as user:group. Help will be appreciated.
Thanks
... View more