@JoaquinS   Got the link now and it says "A Spark 1.6 service can co-exist on the same cluster as Spark 2."   https://www.cloudera.com/documentation/spark2/latest/topics/spark2_requirements.html       ... View more

@JoaquinS   To my knowledge, you don't need to remove spark 1.x in order to install spark 2.x   You can have both and CM will have separate services for spark (spark 1.x) and spark2 (spark 2.x).   Note: This is only for spark ... View more

@sungsik2   Pls refer this link, it may help you   https://community.cloudera.com/t5/Cloudera-Manager-Installation/Error-JAVA-HOME-is-not-set-and-Java-could-not-be-found/td-p/18974   ... View more

@gsjunior86   You don't need to use IDEs like eclipse, InteliJ, etc... also no need to create jar as part of the exam. You can login as spark-shell (or) pyspark and execute your commands one by one. All they need is your result and this will save your time ... View more

@gsjunior86   You need to apply scala plug-in in Eclipse (Scala Perspective). Scala is not a default one ... View more

@ashishdiwan03   FYI, i got multple confirmations from a different community where the people confirmed that there is no template provided.   Cloudera Stmt: it is possible to get templates so that all coding is not done from scratch.   Also according to cloudera statement, there is no confirmation that template will be provided, they are saying it is possible but not mandatory. So even template provided, it is not mandatory to use the template , I mean if you are familiar with Scala but you got Python template then it is not mandatory to use Python template, instead you can delete the template and write code in Scala --Because template is provided to help you but not to force you to follow either Python/Scala. All they need is your result   So I want to reconfirm that to appear for CCA175 - it is good to know both Scala/Python but If you are master in Scala but don't know python, Still you can appear for the exam and write your code using Scala     ... View more

@anis016   I have a question on your command.    Can we execute "hadoop jar <jar>" command and environment variable setup command (HADOOP_OPTS) as a single command? I never tried that before... not sure I am missing something here   Becuase usually environement variable setup command will be prefixed with the keyword 'export' ... I don't know this will fix your issue but you can try to execute them separately as mentioned below.. it may help       export HADOOP_OPTS="-Djava.security.auth.login.config=/etc/solr/conf/jass.conf"   hadoop jar /usr/lib/solr/contrib/mr/search-mr-*-job.jar org.apache.solr.hadoop.MapReduceIndexerTool \ -D 'mapred.child.java.opts=-Xmx2048m' \ --log4j /usr/share/doc/search-1.0.0+cdh5.10.0+0/examples/solr-nrt/log4j.properties \ --morphline-file /home/cloudera/workspace/solr_home/morphlines/csv_morphline.conf \ --output-dir hdfs://quickstart.cloudera:8020/user/hdfs/test_output \ --verbose \ --go-live \ --zk-host quickstart.cloudera:2181/solr \ --collection csv_collection \ hdfs://quickstart.cloudera:8020/user/hdfs/test_input/books.cs   ... View more

@Adarsh03   To my knowledge, no need to create a jar file.. Instead you need to store all your commands in a notepad and execute one by one in spark shell command line ... View more

@ashishdiwan03   oh ok! thank you for the update! (the info that I got from the other community may be wrong ) but it is good that you have mailed cloudera for the confirmation...  ... View more