Member since
08-01-2017
3
Posts
0
Kudos Received
0
Solutions
08-02-2017
07:10 AM
@mbigelow Thanks for your reply too. "hdfs dfsadmin -setSpaceQuota" wont work on HDFS temp location. Need to find out some other alternative.
... View more
08-02-2017
07:08 AM
@saranvisa, Thanks for your reply. I am talking about HDFS temp file system, not on the host machine temp file system. Please advise.
... View more
08-01-2017
07:43 AM
In our Hadoop cluster (Cloudera distribution), we recently found that Hive Job started by a user create a 160 TB of files in '/tmp' location and it almost consumed remaining HDFS space and about to cause an outage. Later we troubleshoot and kill the particular job as we are unable to reach the user who started this job. So now my question is - how could we able to set an alert for '/tmp' location if anyone created huge files or can we restrict the users using HDFS '/tmp' space? Please share if you have any other suggestions.
... View more
Labels:
- Labels:
-
Apache Hive
-
Cloudera Manager
-
HDFS