Created 09-26-2017 06:56 PM
I am using the following syntax: hadoop distcp hdfs://<SRC_CLUSTER>/<SRC_DIR> maprfs://<TGT_CLUSTER>:<PORT>/<TGT_DIR> . The statement fails with: Invalid arguments: java.lang.ClassNotFoundException: Class com.mapr.fs.MapRFileSystem not found. The HDP cluster is kerberized and the MapR cluster isn't. Can someone please help me here.
Created 06-11-2018 03:37 AM
HDP distribution doesn't support Mapr Filesystem not it have Mapr class jars. The above error is nothing to do with Kerborized env. My suggestion will be having Mapr NFSmount on client node and use hadoop copyFromLocal and copy the file to HDFS and vise versa.
Created 01-04-2019 11:43 AM
This can also be achieved using webhdfs but make sure it is enabled.
Command for example
hadoop distcp maprfs:///path/tempdir webhdfs://hostname:50070/path/tempdir