About SimonBergerard

SimonBergerard · ‎11-23-2021

I'm using The CDE version "1.12.0-b119"

SimonBergerard · ‎11-09-2021

Hi every one, I encountered the following error when I ran a cde cli command launching spark or airflow job. ERROR Start TGT gen failed for user: my_user, error: rpc error: code = Internal desc = java.lang.RuntimeException: com.cloudera.thunderhead.service.tgtgenerator.services.KeytabException: unable to get keytab fileName Have you ever seen this before? To resolve this issue, I just ran my command again and it passed after some tries. Does someone have a solution to pass this command at the first time? My command seems: cde job run --name my_job_name --variable var1=$(date +'%Y%m%d%H%M%S') --variable var2=$(date +'%Y%m%d%H%M%S') --variable var3=100 --variable var4=yyyyMMddHHmmss Thank you

SimonBergerard · ‎10-25-2021

Hi everyone, I tried to run a spark job on Cloudera by overwriting some basics spark configurations. So I created a spark job with the following Configurations (optional): spark.eventLog.dir = myPath spark.eventLog.enabled = true spark.submit.deployMode = cluster I have executed this job by running a cde cli command. The submitter keeps my overwriting values for these 3 Spark configurations but these values weren't retrieve in my Spark driver. For instance, I found a "default" tmpPath for spark.eventLog.dir instead of myPath and my driver used a client deployMode. Some other configurations (like spark.history.fs.logDirectory) were well overwriting at the same time. Have you ever met this problem? Thank you 🙂

Online	Offline
Last Visited	‎01-07-2022 12:09 PM

Date Registered	‎10-25-2021 05:49 AM
Last Visited	‎01-07-2022 12:09 PM
Total Messages Posted	3
Total Kudos Received	1

Re: Start TGT gen failed for user - KeytabExceptio...

Start TGT gen failed for user - KeytabException: u...

My SparkConfigurations are not overwriting in my S...