Cloudera Community
nishi
user rank
Explorer

Re: Extra worker in spark

by Explorer in Support Questions
‎09-03-2014 12:04 AM
‎09-03-2014 12:04 AM
Thanks you very much   It solved my problem. ... View more

Re: Extra worker in spark

by Explorer in Support Questions
‎09-01-2014 04:08 AM
‎09-01-2014 04:08 AM
Problem is that It doesn't reflect second host information inside, add role instance> select host. It is only showing my current host and all it's information. Could you please let me know, why it is happening. ... View more

Re: Extra worker in spark

by Explorer in Support Questions
‎09-01-2014 12:45 AM
‎09-01-2014 12:45 AM
Thanks a lot I am going through your suggestion to create more number of partition in RDD to achieve groupByKey on stream data. Meanwhile, Could you please let me know how to add another worker in different host. I have 2 m/c where cloudera enterprise data hub edition 5.1.0 is installed. I want one master and 2 workers. one worker will be on another machine. ... View more

Re: Extra worker in spark

by Explorer in Support Questions
‎08-29-2014 12:54 AM
‎08-29-2014 12:54 AM
Hi All,    I am not able to create one extra worker in spark in CDH. I need 2 workers with 1 master in my cdh spark. CDH spark has 1 master and 1 worker as default , this way I am not able to do group by opearion on streams. because of that I am looking for minimum 2 workers.   Thanks in advance Nishi   ... View more

Re: Extra worker in spark

by Explorer in Support Questions
‎08-28-2014 05:48 AM
‎08-28-2014 05:48 AM
I had installed spark outside the CDH to verify the steps those are required to create extra worker in standalone mode. As per your reply go to Spark service in Cloudera Manager, click Instances, click Add Role Instances. here I want to give same host as another worker but it not taking. Could you provide some screen shot or something and reply to my mail ID- nkantkumar@gmail.com ... View more

Extra worker in spark

by Explorer in Support Questions
‎08-28-2014 04:54 AM
‎08-28-2014 04:54 AM
Hi All,   I have cloudera enterprise data hub edition 5.1.0 installed in a single system. Due to some requirement I need to create one extra worker in spark. Currently, it has 1 master and 1 worker running but I want 1 master and 2 worker. I have tried to create following the guideline of CDH(added SPARK_WORKER_INSTANCES=2) in spark-env.sh. It didn't worked for me.    I followed the same steps in spark out of CDH(just downlaoded from apache website) I am able create extra worker.   Could someone let me know what would be steps for creating extra worker in spark inside CDH 5.1.0?     Thanks in advance. Nishikant   ... View more
Contact Me
Online
Offline
Last Visited
‎09-22-2014 08:17 AM
Community Statistics
Member Since ‎08-28-2014 04:54 AM
Last Visited ‎09-22-2014 08:17 AM
Posts 9