Member since
09-19-2019
3
Posts
0
Kudos Received
0
Solutions
09-20-2019
02:06 AM
.@Shelton yeah sure here are both stdout.log Fri Sep 20 14:30:58 IST 2019
Current working directory: /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a
Launching one-off process: /usr/lib64/cmf/service/dr/precopylistingcheck.sh -bandwidth 100 -i -m 20 -prbugp -update -log /user/hdfs/.cm/distcp/2019-09-20_424 -sequenceFilePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/fileList.seq -diffRenameDeletePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/renamesDeletesList.seq -sourceconf source-client-conf -copyListingOnSource -useSnapshots distcp-4-46481528 -ignoreSnapshotFailures -strategy dynamic -filters exclusion-filter.list -scheduleId 4 -scheduleName test_backup /data /data
Fri Sep 20 14:30:58 IST 2019
Running on: manager.local (192.168.251.5)
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Skipping sourcing equivalent of /etc/default/hadoop due to missing CDH_VERSION
using /usr/java/jdk1.7.0_67-cloudera as JAVA_HOME
using as CDH_VERSION
using /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a as CONF_DIR
CONF_DIR=/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a
CMF_CONF_DIR=/etc/cloudera-scm-agent
Hadoop Home is /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop stderr.log Fri Sep 20 14:30:58 IST 2019
Fri Sep 20 14:30:58 IST 2019
+++ hostname -f
+++ hostname -i
++ echo 'Running on: manager.local (192.168.251.5)'
+++ dirname /usr/lib64/cmf/service/dr/precopylistingcheck.sh
++ cloudera_config=/usr/lib64/cmf/service/dr
+++ cd /usr/lib64/cmf/service/dr/../common
+++ pwd
++ cloudera_config=/usr/lib64/cmf/service/common
++ . /usr/lib64/cmf/service/common/cloudera-config.sh
+++ set -x
++ source_parcel_environment
++ '[' '!' -z /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/meta/cdh_env.sh ']'
++ OLD_IFS='
'
++ IFS=:
++ SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS)
++ DIRNAME_ARRAY=($PARCEL_DIRNAMES)
++ IFS='
'
++ COUNT=1
+++ seq 1 1
++ for i in '`seq 1 $COUNT`'
++ SCRIPT=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/meta/cdh_env.sh
++ PARCEL_DIRNAME=CDH-5.16.2-1.cdh5.16.2.p0.8
++ . /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/meta/cdh_env.sh
+++ CDH_DIRNAME=CDH-5.16.2-1.cdh5.16.2.p0.8
+++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-0.20-mapreduce
+++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-0.20-mapreduce
+++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-hdfs
+++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-hdfs
+++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-httpfs
+++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-httpfs
+++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-mapreduce
+++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-mapreduce
+++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-yarn
+++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-yarn
+++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase
+++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase
+++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/zookeeper
+++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/zookeeper
+++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive
+++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive
+++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hue
+++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hue
+++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/oozie
+++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/oozie
+++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+++ export CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/flume-ng
+++ CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/flume-ng
+++ export CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/pig
+++ CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/pig
+++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive-hcatalog
+++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hive-hcatalog
+++ export CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sqoop2
+++ CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sqoop2
+++ export CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/llama
+++ CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/llama
+++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sentry
+++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/sentry
+++ export TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-tomcat
+++ TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-tomcat
+++ export JSVC_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils
+++ JSVC_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils
+++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop/bin/hadoop
+++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop/bin/hadoop
+++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/impala
+++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/impala
+++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/solr
+++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/solr
+++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase-solr
+++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hbase-solr
+++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/search
+++ SEARCH_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/search
+++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/spark
+++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/spark
+++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/etc/hive-webhcat/conf.dist/webhcat-default.xml
+++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/etc/hive-webhcat/conf.dist/webhcat-default.xml
+++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-kms
+++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-kms
+++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/parquet
+++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/parquet
+++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/avro
+++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/avro
+++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/kudu
+++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/kudu
++ locate_cdh_java_home
++ '[' -z '' ']'
++ '[' -z /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils ']'
++ local BIGTOP_DETECT_JAVAHOME=
++ for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"'
++ '[' -e /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome ']'
++ BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome
++ break
++ '[' -z /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome ']'
++ . /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/bigtop-utils/bigtop-detect-javahome
+++ BIGTOP_DEFAULTS_DIR=/etc/default
+++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']'
+++ JAVA6_HOME_CANDIDATES=('/usr/lib/j2sdk1.6-sun' '/usr/lib/jvm/java-6-sun' '/usr/lib/jvm/java-1.6.0-sun-1.6.0' '/usr/lib/jvm/j2sdk1.6-oracle' '/usr/lib/jvm/j2sdk1.6-oracle/jre' '/usr/java/jdk1.6' '/usr/java/jre1.6')
+++ OPENJAVA6_HOME_CANDIDATES=('/usr/lib/jvm/java-1.6.0-openjdk' '/usr/lib/jvm/jre-1.6.0-openjdk')
+++ JAVA7_HOME_CANDIDATES=('/usr/java/jdk1.7' '/usr/java/jre1.7' '/usr/lib/jvm/j2sdk1.7-oracle' '/usr/lib/jvm/j2sdk1.7-oracle/jre' '/usr/lib/jvm/java-7-oracle')
+++ OPENJAVA7_HOME_CANDIDATES=('/usr/lib/jvm/java-1.7.0-openjdk' '/usr/lib/jvm/java-7-openjdk')
+++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle')
+++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk' '/usr/lib64/jvm/java-1.8.0-openjdk' '/usr/lib64/jvm/java-8-openjdk')
+++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk')
+++ case ${BIGTOP_JAVA_MAJOR} in
+++ JAVA_HOME_CANDIDATES=(${JAVA7_HOME_CANDIDATES[@]} ${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA7_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]})
+++ '[' -z '' ']'
+++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}'
++++ ls -rvd /usr/java/jdk1.7.0_67-cloudera
+++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`'
+++ '[' -e /usr/java/jdk1.7.0_67-cloudera/bin/java ']'
+++ export JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
+++ JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
+++ break 2
++ verify_java_home
++ '[' -z /usr/java/jdk1.7.0_67-cloudera ']'
++ echo JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
++ . /usr/lib64/cmf/service/common/cdh-default-hadoop
+++ [[ -z '' ]]
+++ echo 'Skipping sourcing equivalent of /etc/default/hadoop due to missing CDH_VERSION'
++ echo 'using /usr/java/jdk1.7.0_67-cloudera as JAVA_HOME'
++ echo 'using as CDH_VERSION'
++ echo 'using /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a as CONF_DIR'
++ set_hadoop_classpath
++ set_classpath_in_var HADOOP_CLASSPATH
++ '[' -z HADOOP_CLASSPATH ']'
++ [[ -n /usr/share/cmf ]]
+++ find /usr/share/cmf/lib/plugins -maxdepth 1 -name '*.jar'
+++ tr '\n' :
++ ADD_TO_CP=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:
++ [[ -n '' ]]
++ eval 'OLD_VALUE=$HADOOP_CLASSPATH'
+++ OLD_VALUE=
++ NEW_VALUE=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:
++ export HADOOP_CLASSPATH=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
++ HADOOP_CLASSPATH=/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
++ replace_conf_dir
++ echo CONF_DIR=/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a
++ echo CMF_CONF_DIR=/etc/cloudera-scm-agent
++ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks')
+++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' '*.keytab' '*jceks'
++ find /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a -type f '!' -path '/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name '*.keytab' '!' -name '*jceks' -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a#g' '{}' ';'
++ export 'HADOOP_OPTS=-Djava.net.preferIPv4Stack=true '
++ HADOOP_OPTS='-Djava.net.preferIPv4Stack=true '
++ acquire_kerberos_tgt hdfs.keytab
++ '[' -z hdfs.keytab ']'
++ '[' -n '' ']'
+++ echo /usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar
++ ACLLIB_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar
++ export HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
++ HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar
+ HADOOP_HOME=/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop
+ echo 'Hadoop Home is /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop'
++ echo /usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ DISTCP_CLASSPATH=/usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ export HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:/usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ HADOOP_CLASSPATH=/usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar:/usr/share/cmf/lib/plugins/event-publish-5.16.2-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.16.2.jar:/usr/share/cmf/lib/dr/distcp-5.16.2.jar
+ exec /opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop/bin/hadoop com.cloudera.enterprise.distcp.PreCopyListingCheck -libjars /usr/share/cmf/lib/dr/distcp_acllib-5.16.2.jar -summaryFile /var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a/logs/summary.json -bandwidth 100 -i -m 20 -prbugp -update -log /user/hdfs/.cm/distcp/2019-09-20_424 -sequenceFilePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/fileList.seq -diffRenameDeletePath /user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/renamesDeletesList.seq -sourceconf source-client-conf -copyListingOnSource -useSnapshots distcp-4-46481528 -ignoreSnapshotFailures -strategy dynamic -filters exclusion-filter.list -scheduleId 4 -scheduleName test_backup /data /data
19/09/20 14:31:03 INFO util.VersionChecker: Inferred CDH version >= 52
19/09/20 14:31:03 INFO distcp.PreCopyListingCheck: Input Options: DistCpOptions{atomicCommit=false, syncFolder=true, deleteMissing=false, ignoreFailures=true, maxMaps=20, sslConfigurationFile='null', copyStrategy='dynamic', sourceFileListing=null, sourcePaths=[/data], targetPath=/, sequenceFilePath=/user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/fileList.seq, diffRenameDeletePath=/user/PROXY_USER_PLACEHOLDER/.cm/distcp-staging/2019-09-20-09-00-55-21d8feb4/renamesDeletesList.seq, summaryFile=/var/run/cloudera-scm-agent/process/126-hdfs-precopylistingcheck-27538a3a/logs/summary.json, dryRun=false, dryRunReadSize=512, dryRunMaxFiles=1024, logPath=/user/hdfs/.cm/distcp/2019-09-20_424, proxyUser=null, sourceProxyUser=null, overwrite=false, skipCRC=false, skipListingCRC=false, blocking=true, mapBandwidth=100, preserveStatus=[REPLICATION, BLOCKSIZE, USER, GROUP, PERMISSION], atomicWorkPath=null, sourceConf=source-client-conf, useWebHdfsForSource=false, sourcePrincipal=null, sourceTicketCache=null, rebase=false, useSnapshots=true, ignoreSnapshotFailures=true, skipTrash=false, preserveRawXattrs=false, filtersFile='exclusion-filter.list', skipAclErr=false, useDiff=false, ignoreDiff=false, raiseSnapshotDiffFailures=false, useDistCpFileStatus=false, replaceNameservice=false, append=false, skipOwnershipCheck=false, skipDefaultJobStagingDir=false, copyListingOnSource=true, cloudUsage=null}
19/09/20 14:31:04 INFO util.FsCache: Created file system client instance for key : [null, hdfs, manager.local:8020, hdfs (auth:SIMPLE), null, 512, null]
19/09/20 14:31:04 INFO util.DistCpUtils: Replicate ACL: false
19/09/20 14:31:04 INFO util.DistCpUtils: Replicate XAttr: false
19/09/20 14:31:05 INFO distcp.PreCopyListingCheck: Done in: (seconds) 1.562 one more thing is that in one of my VM i have CM version 5.13.0 and other one is 5.16.2
... View more
09-19-2019
09:03 PM
@Shelton Yes i did Followed same procedure shown in BDR Tutorials and yes i am using cloudera's quickstart Virtual Machine for the same i have taken 2 VM of that and apply this steps this is the error which occurred
... View more
09-19-2019
04:45 AM
I am new to Cloudera and i am trying to do backup and disaster recovery in cloudera enterprise trial version i followed all steps shown in demo video of cloudera for BDR but its throwing this error
The remote command failed with error message: quickstart.cloudera"
... View more
Labels:
- Labels:
-
Apache Hadoop