Member since
02-09-2017
10
Posts
1
Kudos Received
0
Solutions
08-15-2017
03:51 PM
The parameter to specify more than one path for storage in Hadoop is in hdfs-site.xml. Property: dfs.datanode.data.dir (Please verify) dfs.datanode.data.dir value can be any directory which is available on the datanode.It determines where on the local filesystem data node should store its blocks. It can be a directory where disk partitions are mounted like '/user1/hadoop/data, /user2/hadoop/data' which is in case if you have multiple disks partitions to be used for HDFS the purpose. When it has multiple values, data is copied to the HDFS in a round-robin fashion. If one of the directory's disk is full, round-robin data copy will continue on the rest of the directories. You can also define the Storage system in the HDFS for multiple locations Please refer below link. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_hdfs_admin_tools/content/configuring_archival_storage.html
... View more
03-14-2017
04:40 PM
The error is because of the Hive server is filling up the logs in Hive node, so it is not able to create or write the file in the /var/log/hive directory.
... View more