@Tony Cheng The error: unable to get client certificate at In the xa-portal.log means truststore has not been properly configured for ranger admin. I suggest you review the following video where I cover this configuration in detail: https://community.hortonworks.com/content/supportkb/187924/video-kb-how-to-co-nfigure-ranger-admin-ssl.html Also there is a good hc article that covers this configuration for nifi: https://community.hortonworks.com/articles/60001/hdf-20-integrating-secured-nifi-with-secured-range.html HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more

@Bhushan Kandalkar For Common Name for Certificate use a comma separated list (no spaces before of after comma). For example: hmaster.test.org,hmaster2.test.org I haven't got the chance to test 1-way ssl between plugins and ranger admin yet. However, by looking at the following jira https://issues.apache.org/jira/browse/RANGER-1094 This shows as fixed in ranger 0.6.3 and hdp-2.5.6 comes with ranger 0.6 so perhaps is still not supported in your version. HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more

@Bhushan Kandalkar I think this is due your ranger admin truststore may not be properly configured. You may want to check the following video on how to setup ranger admin ssl: https://community.hortonworks.com/content/supportkb/187924/video-kb-how-to-co-nfigure-ranger-admin-ssl.html and as a followup step you should add the hive public certificate to the ranger admin truststore. HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more

@Erkan ŞİRİN This is not a compile time option. Its runtime and should be set in the command line not in code by spark session options. If you are you running this code from eclipse you should add this as an argument to the java directly -Xss. Else if running using spark-submit command then add as I indicated before. With these settings at least it should take longer to error out since you will be making the memory area for stack bigger to fill. HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more

Hi @Erkan ŞİRİN, have you tried to increase the stack memory space using -Xss flag? If not you may want to try something like this: --conf "spark.executor.extraJavaOptions='-Xss512m'" --driver-java-options "-Xss512m" HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more

@Manikandan Jeyabal I think there may be a project level problem on yours. Therefore I'm sharing a very simple dummy project that is compiling fine in my environment (this is only shared as an example and is not meant to be used in real production): sparktest.zip Hopefully with this project you will be able to figure out what is wrong when comparing with yours. Note: You can use command line sbt compile and sbt package to get the jar This is the output I get when I run it: SPARK_MAJOR_VERSION=2 spark-submit /root/projects/sparktest/target/scala-2.11/hello_2.11-0.1.0-SNAPSHOT.jar Hello SPARK_MAJOR_VERSION is set to 2, using Spark2 hello root |-- Airline_id: integer (nullable = true) |-- Name: string (nullable = true) |-- Alias: string (nullable = true) |-- IATA: string (nullable = true) |-- ICAO: string (nullable = true) |-- Callsign: string (nullable = true) |-- Country: string (nullable = true) |-- Active: string (nullable = true) HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more