Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Getting Error while Replication Schedule in BDR

Highlighted

Getting Error while Replication Schedule in BDR

New Contributor

I am new to Cloudera and i am trying to do backup and disaster recovery in cloudera enterprise trial version i followed all steps shown in demo video of cloudera for BDR but its throwing this error 

 

The remote command failed with error message: quickstart.cloudera"

 

4 REPLIES 4

Re: Getting Error while Replication Schedule in BDR

Mentor

@Must 

There is no attachment the quickstart.cloudera is a VM right?  The configuration is straight forward as you are aware BDR only works for hive and HDFS so can you elaborate what steps you followed and share the error log?
Else here is the link to  Backup and Disaster Recovery

Re: Getting Error while Replication Schedule in BDR

New Contributor

@Shelton Yes i did Followed same procedure shown in BDR Tutorials and yes i am using cloudera's quickstart Virtual Machine for the same i have taken 2 VM of that and apply this steps Annotation 2019-09-20 092758.jpgthis is the error which occurred

Re: Getting Error while Replication Schedule in BDR

Mentor

@Must 

Can you share the full log  as shown below, I would like to reproduce it later today 

 

fulll log.PNG

 

Re: Getting Error while Replication Schedule in BDR

New Contributor

.@Shelton  yeah sure here are both stdout.log

Fri Sep 20 14:30:58 IST 2019
Current working directory: /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a
Launching one-off process: /usr/lib64/cmf/service/dr/precopylistingcheck.sh -bandwidth 100 -i -m 20 -prbugp -update -log /user/hdfs/.cm/distcp/2019-09-20_424 -sequenceFilePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/fileList.seq -diffRenameDeletePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/renamesDeletesList.seq -sourceconf source-client-conf -copyListingOnSource -useSnapshots distcp-4-46481528 -ignoreSnapshotFailures -strategy dynamic -filters exclusion-filter.list -scheduleId 4 -scheduleName test_backup /data /data
Fri Sep 20 14:30:58 IST 2019
Running on: manager.local (192.168.251.5)
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Skipping sourcing equivalent of /etc/default/hadoop due to missing CDH_VERSION
using /usr/java/jdk1.7.0_67-cloudera as JAVA_HOME
using  as CDH_VERSION
using /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a as CONF_DIR
CONF_DIR=/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a
CMF_CONF_DIR=/etc/cloudera-scm-agent
Hadoop Home is /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop

stderr.log

Fri Sep 20 14:30:58 IST 2019
Fri Sep 20 14:30:58 IST 2019
+++ hostname -f
+++ hostname -i
++ echo 'Running on: manager.local (192.168.251.5)'
+++ dirname /usr/lib64/cmf/service/dr/precopylistingcheck.sh
++ cloudera_config=/usr/lib64/cmf/service/dr
+++ cd /usr/lib64/cmf/service/dr/../common
+++ pwd
++ cloudera_config=/usr/lib64/cmf/service/common
++ . /usr/lib64/cmf/service/common/cloudera-config.sh
+++ set -x
++ source_parcel_environment
++ '[' '!' -z /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/meta/cdh_env.sh ']'
++ OLD_IFS=' 	
'
++ IFS=:
++ SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS)
++ DIRNAME_ARRAY=($PARCEL_DIRNAMES)
++ IFS=' 	
'
++ COUNT=1
+++ seq 1 1
++ for i in '`seq 1 $COUNT`'
++ SCRIPT=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/meta/cdh_env.sh
++ PARCEL_DIRNAME=CDH-5.16.2-1.cdh5.16.2.p0.8
++ . /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/meta/cdh_env.sh
+++ CDH_DIRNAME=CDH-5.16.2-1.cdh5.16.2.p0.8
+++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-0.20-mapreduce
+++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-0.20-mapreduce
+++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-hdfs
+++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-hdfs
+++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-httpfs
+++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-httpfs
+++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-mapreduce
+++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-mapreduce
+++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-yarn
+++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-yarn
+++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase
+++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase
+++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/zookeeper
+++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/zookeeper
+++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive
+++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive
+++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hue
+++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hue
+++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/oozie
+++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/oozie
+++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ export CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/flume-ng
+++ CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/flume-ng
+++ export CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/pig
+++ CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/pig
+++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive-hcatalog
+++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive-hcatalog
+++ export CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sqoop2
+++ CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sqoop2
+++ export CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/llama
+++ CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/llama
+++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sentry
+++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sentry
+++ export TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-tomcat
+++ TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-tomcat
+++ export JSVC_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils
+++ JSVC_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils
+++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop/bin/hadoop
+++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop/bin/hadoop
+++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/impala
+++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/impala
+++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/solr
+++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/solr
+++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase-solr
+++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase-solr
+++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/search
+++ SEARCH_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/search
+++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/spark
+++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/spark
+++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/etc/hive-webhcat/conf.dist/webhcat-default.xml
+++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/etc/hive-webhcat/conf.dist/webhcat-default.xml
+++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-kms
+++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-kms
+++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/parquet
+++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/parquet
+++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/avro
+++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/avro
+++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/kudu
+++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/kudu
++ locate_cdh_java_home
++ '[' -z '' ']'
++ '[' -z /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils ']'
++ local BIGTOP_DETECT_JAVAHOME=
++ for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"'
++ '[' -e /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome ']'
++ BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome
++ break
++ '[' -z /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome ']'
++ . /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome
+++ BIGTOP_DEFAULTS_DIR=/etc/default
+++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']'
+++ JAVA6_HOME_CANDIDATES=('/usr/lib/j2sdk1.6-sun' '/usr/lib/jvm/java-6-sun' '/usr/lib/jvm/java-1.6.0-sun-1.6.0' '/usr/lib/jvm/j2sdk1.6-oracle' '/usr/lib/jvm/j2sdk1.6-oracle/jre' '/usr/java/jdk1.6' '/usr/java/jre1.6')
+++ OPENJAVA6_HOME_CANDIDATES=('/usr/lib/jvm/java-1.6.0-openjdk' '/usr/lib/jvm/jre-1.6.0-openjdk')
+++ JAVA7_HOME_CANDIDATES=('/usr/java/jdk1.7' '/usr/java/jre1.7' '/usr/lib/jvm/j2sdk1.7-oracle' '/usr/lib/jvm/j2sdk1.7-oracle/jre' '/usr/lib/jvm/java-7-oracle')
+++ OPENJAVA7_HOME_CANDIDATES=('/usr/lib/jvm/java-1.7.0-openjdk' '/usr/lib/jvm/java-7-openjdk')
+++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle')
+++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk' '/usr/lib64/jvm/java-1.8.0-openjdk' '/usr/lib64/jvm/java-8-openjdk')
+++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk')
+++ case ${BIGTOP_JAVA_MAJOR} in
+++ JAVA_HOME_CANDIDATES=(${JAVA7_HOME_CANDIDATES[@]} ${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA7_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]})
+++ '[' -z '' ']'
+++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}'
++++ ls -rvd /usr/java/jdk1.7.0_67-cloudera
+++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`'
+++ '[' -e /usr/java/jdk1.7.0_67-cloudera/bin/java ']'
+++ export JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
+++ JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
+++ break 2
++ verify_java_home
++ '[' -z /usr/java/jdk1.7.0_67-cloudera ']'
++ echo JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
++ . /usr/lib64/cmf/service/common/cdh-default-hadoop
+++ [[ -z '' ]]
+++ echo 'Skipping sourcing equivalent of /etc/default/hadoop due to missing CDH_VERSION'
++ echo 'using /usr/java/jdk1.7.0_67-cloudera as JAVA_HOME'
++ echo 'using  as CDH_VERSION'
++ echo 'using /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a as CONF_DIR'
++ set_hadoop_classpath
++ set_classpath_in_var HADOOP_CLASSPATH
++ '[' -z HADOOP_CLASSPATH ']'
++ [[ -n /usr/share/cmf ]]
+++ find /usr/share/cmf/lib/plugins -maxdepth 1 -name '*.jar'
+++ tr '\n' :
++ ADD_TO_CP=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:
++ [[ -n '' ]]
++ eval 'OLD_VALUE=$HADOOP_CLASSPATH'
+++ OLD_VALUE=
++ NEW_VALUE=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:
++ export HADOOP_CLASSPATH=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
++ HADOOP_CLASSPATH=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
++ replace_conf_dir
++ echo CONF_DIR=/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a
++ echo CMF_CONF_DIR=/etc/cloudera-scm-agent
++ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks')
+++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' '*.keytab' '*jceks'
++ find /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a -type f '!' -path '/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name '*.keytab' '!' -name '*jceks' -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a#g' '{}' ';'
++ export 'HADOOP_OPTS=-Djava.net.preferIPv4Stack=true '
++ HADOOP_OPTS='-Djava.net.preferIPv4Stack=true '
++ acquire_kerberos_tgt hdfs.keytab
++ '[' -z hdfs.keytab ']'
++ '[' -n '' ']'
+++ echo /usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar
++ ACLLIB_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar
++ export HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
++ HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
+ HADOOP_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+ echo 'Hadoop Home is /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop'
++ echo /usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ DISTCP_CLASSPATH=/usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ export HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:/usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:/usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ exec /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop/bin/hadoop com.cloudera.enterprise.distcp.PreCopyListingCheck -libjars /usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar -summaryFile /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a/logs/summary.json -bandwidth 100 -i -m 20 -prbugp -update -log /user/hdfs/.cm/distcp/2019-09-20_424 -sequenceFilePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/fileList.seq -diffRenameDeletePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/renamesDeletesList.seq -sourceconf source-client-conf -copyListingOnSource -useSnapshots distcp-4-46481528 -ignoreSnapshotFailures -strategy dynamic -filters exclusion-filter.list -scheduleId 4 -scheduleName test_backup /data /data
19/09/20 14:31:03 INFO util.VersionChecker: Inferred CDH version >= 52
19/09/20 14:31:03 INFO distcp.PreCopyListingCheck: Input Options: DistCpOptions{atomicCommit=false, syncFolder=true, deleteMissing=false, ignoreFailures=true, maxMaps=20, sslConfigurationFile='null', copyStrategy='dynamic', sourceFileListing=null, sourcePaths=[/data], targetPath=/, sequenceFilePath=/user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/fileList.seq, diffRenameDeletePath=/user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/renamesDeletesList.seq, summaryFile=/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a/logs/summary.json, dryRun=false, dryRunReadSize=512, dryRunMaxFiles=1024, logPath=/user/hdfs/.cm/distcp/2019-09-20_424, proxyUser=null, sourceProxyUser=null, overwrite=false, skipCRC=false, skipListingCRC=false, blocking=true, mapBandwidth=100, preserveStatus=[REPLICATION, BLOCKSIZE, USER, GROUP, PERMISSION], atomicWorkPath=null, sourceConf=source-client-conf, useWebHdfsForSource=false, sourcePrincipal=null, sourceTicketCache=null, rebase=false, useSnapshots=true, ignoreSnapshotFailures=true, skipTrash=false, preserveRawXattrs=false, filtersFile='exclusion-filter.list', skipAclErr=false, useDiff=false, ignoreDiff=false, raiseSnapshotDiffFailures=false, useDistCpFileStatus=false, replaceNameservice=false, append=false, skipOwnershipCheck=false, skipDefaultJobStagingDir=false, copyListingOnSource=true, cloudUsage=null}
19/09/20 14:31:04 INFO util.FsCache: Created file system client instance for key : [null, hdfs, manager.local:8020, hdfs (auth:SIMPLE), null, 512, null]
19/09/20 14:31:04 INFO util.DistCpUtils: Replicate ACL: false
19/09/20 14:31:04 INFO util.DistCpUtils: Replicate XAttr: false
19/09/20 14:31:05 INFO distcp.PreCopyListingCheck: Done in: (seconds) 1.562

one more thing is that in one of my VM i have  CM version 5.13.0 and other one is 5.16.2

Don't have an account?
Coming from Hortonworks? Activate your account here