Member since
01-13-2016
4
Posts
0
Kudos Received
0
Solutions
05-20-2016
01:50 PM
Is there a way to configure access to mulitple clusters for KNOX via ambari? So we could use multilple httpPaths for different clusters?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Knox
01-13-2016
10:00 PM
Hi, I'm running sandbox 2.3.1. And I'm trying to execute simple count on a hive table. I'm doing it by simply calling spark-sql --master yarn and then executing in spark-sql's shell: select count(*) from sample_08 I'm getting notification: 16/01/13 21:48:02 WARN YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources I've tried to follow ideas specified in this StackOverflow question. I've added spark.dynamicAllocation.enabled parameter to custom spark-default configuration via Ambari, but trying to run spark-sql command from bash gave me only info like this: -- you need to specify number of executors when I've run spark-sql --master yarn --num-executors 2 response was: -- you have dynamic Allocation enabled - you cannot put num executors. Trully "Paragraph 22". I've also tried running spark-sql in local mode, there were no problems What do I need to change to finaly run spark-sql ?
... View more
Labels:
- Labels:
-
Apache Spark