Member since
10-31-2017
3
Posts
0
Kudos Received
0
Solutions
05-10-2018
03:27 AM
I was getting the same error. I solved it by creating the directory on all the machines. (In my case a 3 nodes cluster). So, please make sure that you have "/var/log/spark2/lineage" directory present on all the machines. Also, the ownership should be as follows: chown spark:spark /var/log/spark2/lineage
... View more
11-17-2017
10:03 AM
In your cluster, check on exactly which node you have your hive service running. On that node, you will find log files at "/var/log/hive" location.
... View more
10-31-2017
05:04 AM
Hi , I am trying to installing Spark 2 on my CDH5.12.0 cluster. I have downloaded the CSD SPARK2_ON_YARN-2.1.0.cloudera1.jar in " /opt/cloudera/csd/ " location with ownership as " cloudera-scm" and permissions given are 644. Also the parcel having a similar version is activated. After downloading the jar , I restarted the "cloudera-scm-server". The log file show the below error : ERROR main:com.cloudera.csd.components.CsdLocalRepository: Failed to load CSD from /opt/cloudera/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar, Error: CSD bundle data directory or Jar file doesn't exist I already have " SPARK2_ON_YARN-2.1.0.cloudera1.jar " in the location " /opt/cloudera/csd/" . I have also rechecked the " Local Descriptor Repository Path property." in Administration > Settings. Could anyone help me with this? Thanks , Shaks
... View more
Labels:
- Labels:
-
Apache Spark
-
Cloudera Manager