hi, my partition in /tmp is almost in full capacity, that is why some of my jobs are failing due to space issue, how can I change the default location of the hive query logs of a user? currently it is in the /tmp/user/hive.log. but I want to change it to /data/tmp.
I've tried changing the value of hive.querylog.location in the /etc/hive/conf.cloudera.hive/hive-site.xml in all of servers but still no luck.
You can set the hive scratch directories to modify the intermediate data storage location from default /tmp
|Local Directory where Hive stores jars and data when performing a MapJoin optimization. If not specified, Hive uses a default location.
|Directory in HDFS where Hive writes intermediate data between MapReduce jobs. If not specified, Hive uses a default location.
Hope this helps,
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
What are these properties set to in your yarn configurations?
Also, can you try running below query before your hive query and share results
> set hive.exec.scratchdir=/tmp/mydir;