Following steps working for me:
1.Create mount points: #mkdir /hadoop/hdfs/data1 /hadoop/hdfs/data2
/hadoop/hdfs/data3 #chown hdfs:hadoop /hadoop/hdfs/data1 /hadoop/hdfs/data2
/hadoop/hdfs/data3 (**We are using
the configuration for test purpose only, so no disks are mounted.)
2.Login to Ambari > HDFS>setting 3.Add datanode directories as shown
below: Datanode>datanode
directories: [DISK]/hadoop/hdfs/data,[SSD]/hadoop/hdfs/data1,[RAMDISK]/hadoop/hdfs/data2,[ARCHIVE]/hadoop/hdfs/data3 Restart hdfs hdfs service. Restart all other afftected services. Create a directory
/cold # su hdfs [hdfs@hdp-qa2-n1 ~]$
hadoop fs -mkdir /cold Set COLD storage policy
on /cold [hdfs@hdp-qa2-n1 ~]$
hdfs storagepolicies -setStoragePolicy -path /cold -policy COLD Set storage policy
COLD on /cold 5. Run get storage
policy: [hdfs@hdp-qa2-n1 ~]$
hdfs storagepolicies -getStoragePolicy -path /cold The storage policy of
/cold: BlockStoragePolicy{COLD:2,
storageTypes=[ARCHIVE], creationFallbacks=[], replicationFallbacks=[]}
... View more
