HDFS version: 188.8.131.52.3
1. su hdfs
2. cd /home/hdfs
3. hadoop jar tkfc-static-wordlist-10.jar 1 issue money 20150601 (extracting data elements from webpages)
1. usage non used DFS Continued to increase
2. HDFS service will shut down
You can increase space for non-HDFS use by setting dfs.datanode.du.reserved to a larger value. It's set per disk volume. The default is 1G, but we usually set it to 10G. You can increase it further depending on number of your disks and their capacity. However, non HDFS space is not used by History Server but to store for example output of mappers in a MR job.
This approach seems only delay occurred at a time, after the release of this issue will be resolved?
When will the update to hdp?