Cloudera Community
yogen
user rank
Contributor

Re: Adding Spark 2.2

by Contributor in Support Questions
‎11-13-2017 03:21 PM
‎11-13-2017 03:21 PM
@Abdelkrim Hadjidj I tried this new version and when I load spark app using Yarn Cluster, I see the that the spark version is still: 2.1.1.2.6.2.0-205 and not 2.2... What am I doing wrong? ... View more

Re: SparkContext did not initialize after waiting ...

by Contributor in Support Questions
‎10-25-2017 02:24 PM
‎10-25-2017 02:24 PM
Found the issue. Turns out that since I run my spark application with --master yarn I should remove this part from the SparkSession builder: .master(masterUrl) ... View more

SparkContext did not initialize after waiting for ...

by Contributor in Support Questions
‎10-25-2017 08:12 AM
‎10-25-2017 08:12 AM
I am trying to run a spark app in hdp cluster. My app keeps failing on: ERROR ApplicationMaster: SparkContext did not initialize after waiting for 100000 ms. Please check earlier log output for errors. Failing the application. In the previous lines the only error (which I see a few times in the log) is: WARN DataSource: Error while looking for metadata directory. Any ideas? ... View more
Labels:

Re: Single Yarn node in HDP

by Contributor in Support Questions
‎10-24-2017 02:21 PM
‎10-24-2017 02:21 PM
@Aditya Sirna Thanks. Is it a problem to install node manager on all 3 nodes? I think that the auto-install process installed it on one of the nodes automatically. One would think that if the auto install only installed on one node - that's the way it should be, no? Are 3 nodes enough for sandboxing or should we have at least 5 as recommended for zookeeper master election? ... View more

Single Yarn node in HDP

by Contributor in Support Questions
‎10-24-2017 02:13 PM
‎10-24-2017 02:13 PM
I installed HDP on 3 nodes and it seems that Yarn is running only in a single node and spark applications also run on 1 node only and work is not distributed on all nodes. Where can I look to understand the issue? ... View more
Labels:

Re: what's the latest hive-jdbc version supported ...

by Contributor in Support Questions
‎10-16-2017 08:24 AM
‎10-16-2017 08:24 AM
the comment helped not the original answer - but I can't mark a comment with 'accept' ... View more

Re: Strange permission issue using hive jdbc

by Contributor in Support Questions
‎10-16-2017 07:55 AM
‎10-16-2017 07:55 AM
Turns out that the user password property names sent to the hive driver in connProps: Connection connection = hiveDriver.connect(serverURL, connProps); were wrong. so the user and password info wasn't sent out. once fixed - the query works. ... View more

Re: Strange permission issue using hive jdbc

by Contributor in Support Questions
‎10-16-2017 07:20 AM
‎10-16-2017 07:20 AM
@Aditya Sirna Thing is I don't know where this 'anonymous' came from (as I am using admin user) and I don't even have a folder named /user/anonymous ... View more

Re: Strange permission issue using hive jdbc

by Contributor in Support Questions
‎10-16-2017 07:16 AM
‎10-16-2017 07:16 AM
@nkumar I am using hiveserver2 ... View more

Strange permission issue using hive jdbc

by Contributor in Support Questions
‎10-16-2017 05:15 AM
‎10-16-2017 05:15 AM
I am running a simple select query that fails on some strange permission issue. I am connecting with specific user and password. see log attached.hive-jdbc-permissions-error.txt ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎11-13-2017 03:19 PM
Community Statistics
Member Since ‎09-28-2017 04:39 AM
Last Visited ‎11-13-2017 03:19 PM
Posts 34
Kudos received 2