Member since
04-19-2023
5
Posts
0
Kudos Received
0
Solutions
06-06-2023
11:38 AM
Hi, Our yarn spark jobs trigger with oozie workflow. there are situations where we need to set a high priority for some of the jobs. I noticed there is a property mapreduce.job.priority to set a priority. how to set a job priority in oozie workflow so that yarn schedules our job with high priority over default from other jobs?
... View more
Labels:
- Labels:
-
Apache Oozie
-
Apache YARN
04-24-2023
07:25 AM
Sorry for late response, I use oozie to submit a spark job
... View more
04-21-2023
02:58 PM
I'm also getting same error when my spark application is trying to connect hbase. Found no valid authentication method from options. @tarekabouzeid91 @Ninads are you able to find the solution to fix this issue?
... View more
04-20-2023
11:38 AM
Thanks @jagadeesan for response. Yes, I'm creating Configuration object and setting all resources (hbase-site.xml, core-site.xml and hdfs-site.xml) for each cluster. the files I'm using are specific to Hbase cluster in configuration object
... View more
04-19-2023
10:18 AM
Hi, I'm running a reconciliation application using Spark. This application needs to connect a table from 2 different clusters Hbase table and compare the data. My application is able to connect and get the data from where the application is running on a cluster. but for remote cluster I'm getting below error failed on local exception: failed on local exception:exception is Failed after attempts=4, exceptions: 2023-04-19T17:11:13.491Z, RpcRetryingCaller{globalStartTime=1681924273451, pause=1000, maxAttempts=4}, java.io.IOException: Call to Host:16020 failed on local exception: java.io.IOException: java.lang.RuntimeException: Found no valid authentication method from options 2023-04-19T17:11:14.505Z, RpcRetryingCaller{globalStartTime=1681924273451, pause=1000, maxAttempts=4}, java.io.IOException: Call to host:16020 failed on local exception: java.io.IOException: java.lang.RuntimeException: Found no valid authentication method from options 2023-04-19T17:11:16.522Z, RpcRetryingCaller{globalStartTime=1681924273451, pause=1000, maxAttempts=4}, java.io.IOException: Call to host:16020 failed on local exception: java.io.IOException: java.lang.RuntimeException: Found no valid authentication method from options 2023-04-19T17:11:19.549Z, RpcRetryingCaller{globalStartTime=1681924273451, pause=1000, maxAttempts=4}, java.io.IOException: Call to host:16020 failed on local exception: java.io.IOException: java.lang.RuntimeException: Found no valid authentication method from options
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Spark