Cleaning Hive temp directory -Permissions problems in CDP Public Cloud

4 replies
3841 views
Translate All

Hello,

due to a problem with a script, we have almost saturated the HDFS available space.

I suppose this is caused by temporary Hive files that have not been cleaned up due to the abnormal termination of the script.

I would like to check the /tmp/hive folder on HDFS but my user, that has administrative privileges, cannot access the /tmp/hive folder.

Is there a way to check and clean such folder?

Any help would be appreciated.

KRs,

Andrea

vinayreddyperamAnswer

Gold ⭐️

Hi Andrea,

use hdfs keytab to clear them

NAME=hdfs;
KEYTAB=$(find /run/cloudera-scm-agent/process -name ${NAME}.keytab -path "*${NAME}-*" | sort | tail -n 1);
PRINCIPAL=$(klist -kt "$KEYTAB" | awk '{ print $4 }' | grep "^${NAME}" | head -n 1);
kinit -kt "${KEYTAB}" "${PRINCIPAL}"

Thanks,

Vinay

JoseManuel

Gold ⭐️

Hi Andrea,

Is this a kerberized environment?

Best,

-JMP

Translate

AndreaCavenagoAuthor

Silver ⭐️⭐️⭐️

Hi JM, yes it's a kerberized environment.

KRs,

Andrea

Translate

vinayreddyperamAnswer

Gold ⭐️

Hi Andrea,

use hdfs keytab to clear them

NAME=hdfs;
KEYTAB=$(find /run/cloudera-scm-agent/process -name ${NAME}.keytab -path "*${NAME}-*" | sort | tail -n 1);
PRINCIPAL=$(klist -kt "$KEYTAB" | awk '{ print $4 }' | grep "^${NAME}" | head -n 1);
kinit -kt "${KEYTAB}" "${PRINCIPAL}"

Thanks,

Vinay

Translate

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.