Member since
08-02-2016
19
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
7123 | 02-14-2017 04:43 AM |
11-14-2017
07:57 AM
Hi!
After change parameter preserveBlockSize & skipChecksum on target site, do not see any change in xml file for task (after recreate task) :
[hdfs@target ~]$ hdfs dfs -ls /apps/falcon/extensions/hdfs-mirroring/retargets/runtime/hdfs-mirroring-workflow.xml
-rwxr-xr-x 2 hdfs users 4943 2017-11-13 22:39 /apps/falcon/extensions/hdfs-mirroring/retargets/runtime/hdfs-mirroring-workflow.xml <<< change this file ( on target size)
[hdfs@target ~]$
t1.xml[hdfs@target ~]$ grep -i preserveBlockSize hdfs-mirroring-workflow.xml
<arg>-preserveBlockSize</arg>
<arg>${preserveBlockSize}</arg>
<arg>-preserveBlockSize</arg> <arg>true</arg>
[hdfs@target ~]$
[hdfs@target ~]$
[hdfs@target ~]$ grep -i skipChecksum hdfs-mirroring-workflow.xml
<arg>-skipChecksum</arg>
<arg>${skipChecksum}</arg>
<arg>-skipChecksum</arg> <arg>true</arg>
[hdfs@target ~]$
Please help me.
Where I can find file hdfs-replication.properties ?
... View more
08-22-2016
04:58 PM
Thank you for the suggestion. distcp All alone runs fine on these sandboxes - it seems to be related to the number of required containers for a Falcon-based distcp replication, One top level app master container, one distcp app master container, then some number of worker containers to perform the actual replication. I believe this is resolved. Thank you again!
... View more
08-04-2016
03:50 PM
Hi @sbhat - this is certainly helpful, thank you for the reference!
... View more
07-02-2019
10:07 AM
1 Kudo
It works in HDP-3.1.0.0 and python 3.7. Thanks! you've saved my day
... View more