Member since
12-02-2014
23
Posts
0
Kudos Received
0
Solutions
06-29-2015
07:02 PM
Thank you Sean for the answer, I actually misspoke and just need to upgrade to Spark 1.3 (I'm using Spark 1.2). I've been trying to use this guide: https://s3.amazonaws.com/quickstart-reference/cloudera/hadoop/latest/doc/Cloudera_EDH_on_AWS.pdf But I am still only getting Spark 1.2, do you have any suggestions on how I can use this guide to get Spark 1.3?
... View more
06-25-2015
06:12 PM
Hello, I have Spark 1.2 running on CDH 5.3.1 and would like to upgrade to Spark 1.3 1) According to these two documentations for 5.4 and 5.0.x http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_spark_install.html http://www.cloudera.com/content/cloudera/en/documentation/cdh5/v5-0-0/CDH5-Installation-Guide/cdh5ig_spark_install.html The command is: sudo yum install spark-core spark-master spark-worker spark-history-server spark-python However, it is saying there is no spark-core, etc. avaialable 2) Do I have to upgrade CDH to run Spark 1.3? Thanks!
... View more
Labels:
06-12-2015
01:40 PM
Well that's embarrasing, I didn't realize that if kafka came under "add a service" the parcels wouldn't be activiated. Activated them and it now works. Thanks!
... View more
06-12-2015
11:38 AM
I saw the other threads regarding this issue and it seems to be a parcel issue? I'm confused on what I need to do with parcels, as for any other service I have added (Hue, Oozie, Spark, etc) I simply followed the instructions on adding the service and it worked. Is there something extra that needs to be done for Kafka? If so, how do we add parcels to the cluster? Here is what I'm doing: 1) Click on Add a service, select Kafka 2) Select host, I've selected the host where ZK is running (i'll call it node 1), I've also individually tried nodes 2-5. 3) Review changes: Data directory: /var/local/kafka/data 4) Start Kafka: Error: Failed to execute command Start on service Kafka Details: Supervisor returned FATAL. Please check the role log file, stderr, or stdout STDERR: ttp:///process/86-kafka-KAFKA_BROKER/files/logs/stderr.log
The server declined access to the page or resource. There are no logs under var/log/kafka or var/lib/kafka (the kafka directories aren't there). Thank you for the help!
... View more
Labels:
12-04-2014
03:52 PM
Thank you, the commands worked! FYI, the linked pdf is returning a 404 error. Thanks again for the help.
... View more
12-04-2014
03:04 PM
Thanks for the info. I am still trying to download Cloudera Director, even the documentation simply says "download cloudera director at: " is there no documentation for steps to download Cloudera Director? Thanks!
... View more
12-04-2014
02:53 PM
Does AWS Quickstart come with Spark installed? Thanks!
... View more
12-04-2014
02:19 PM
I am new to Cloudera so excuse my inaptitude, but what do I do at : http://archive.cloudera.com/director/ubuntu/precise/amd64/director/ Is there documentation as to the detailed steps I need to take to be able to download cloudera director? Thanks a lot for the help!
... View more
12-04-2014
02:06 PM
I am using Ubuntu 12.04 LTS. How do I configure the proper repositories? Thank you!
... View more
12-04-2014
12:23 PM
I am getting this message: Unable to locate package cloudera-director-server when I type in: sudo apt-get install cloudera-director-server cloudera-director-client Thank you for the help!
... View more