Member since
09-28-2017
34
Posts
2
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3447 | 10-25-2017 02:24 PM | |
3536 | 10-16-2017 07:55 AM | |
13528 | 10-03-2017 04:36 AM |
10-25-2017
02:24 PM
Found the issue. Turns out that since I run my spark application with --master yarn I should remove this part from the SparkSession builder: .master(masterUrl)
... View more
10-24-2017
02:31 PM
@Yair Ogen While installing the cluster, in the "Assign Slaves and Clients" page ambari will give an option to select the nodes where you want to install the Node managers. By default only a single node will be selected. You can select other nodes as well to install on them. The no of node managers you want to install depends on no of factors (no of applications you want to run, memory used by apps etc) Check this link for more info https://community.hortonworks.com/questions/82861/how-many-node-managers-should-be-installed.html
... View more
10-16-2017
07:55 AM
Turns out that the user password property names sent to the hive driver in connProps: Connection connection = hiveDriver.connect(serverURL, connProps); were wrong. so the user and password info wasn't sent out. once fixed - the query works.
... View more
10-16-2017
08:28 AM
@Yair Ogen, I wrote the comment as a separate answer. Can you please accept that. Thanks, Aditya
... View more