Member since
10-25-2021
3
Posts
1
Kudos Received
0
Solutions
11-23-2021
01:41 PM
I'm using The CDE version "1.12.0-b119"
... View more
11-09-2021
01:30 AM
1 Kudo
Hi every one, I encountered the following error when I ran a cde cli command launching spark or airflow job. ERROR Start TGT gen failed for user: my_user, error: rpc error: code = Internal desc = java.lang.RuntimeException: com.cloudera.thunderhead.service.tgtgenerator.services.KeytabException: unable to get keytab fileName Have you ever seen this before? To resolve this issue, I just ran my command again and it passed after some tries. Does someone have a solution to pass this command at the first time? My command seems: cde job run --name my_job_name --variable var1=$(date +'%Y%m%d%H%M%S') --variable var2=$(date +'%Y%m%d%H%M%S') --variable var3=100 --variable var4=yyyyMMddHHmmss Thank you
... View more
Labels:
- Labels:
-
Cloudera Data Engineering (CDE)
10-25-2021
06:16 AM
Hi everyone, I tried to run a spark job on Cloudera by overwriting some basics spark configurations. So I created a spark job with the following Configurations (optional): spark.eventLog.dir = myPath spark.eventLog.enabled = true spark.submit.deployMode = cluster I have executed this job by running a cde cli command. The submitter keeps my overwriting values for these 3 Spark configurations but these values weren't retrieve in my Spark driver. For instance, I found a "default" tmpPath for spark.eventLog.dir instead of myPath and my driver used a client deployMode. Some other configurations (like spark.history.fs.logDirectory) were well overwriting at the same time. Have you ever met this problem? Thank you 🙂
... View more
Labels:
- Labels:
-
Cloudera Data Engineering (CDE)