OK Thanks for all ... View more

@Thierry Vernhet If you have more than 10 GB, I'd recommend use distcp instead of using Copy OR Move. ... View more

Thanks a lot Pavan., I've just modified ... $5 == "0" ... by ... $5 != "0" ... because I don't want to move files with "0"size. for f in $(hdfs dfs -ls /tmp/files | awk '$1 !~ /^d/ && $5 != "0" { print $8 }');do hdfs dfs -mv "$f"/tmp/files/exclude-files;done ... View more

Thank You Matt, I too was facing similar issue and your suggestion worked. ... View more

@Wynner Hi, Memory settings already to 8Go for both. This morning I tried to set Number min and max of Entries and it works !!! Thanks for your help Wynner. Regards Parameters set (so the merge create about 1000 files) Minimum Number of Entries 1 Maximum Number of Entries 2500 Minimum Group Size 0 B Maximum Group Size No value set Max Bin Age 5 min Maximum number of Bins 100 Delimiter Strategy Text ... View more

Hi @Pierre Villard Thanks for your answer. ... View more

I'm using the same as you: Beginning of file. I think the version should not matter on this processor: it didn't change since 5 months. However if you are able to try with the PR mentioned above, it may be worth it. ... View more

Hi @Pierre Villard My input is as shown below i, John, $100 ii, Kevin, $150 iii, Steve, $200 I used ExtractText processor with Enable Multiline Mode=true, Enable DOTALL Mode=true and new property line=(.*). After execution I see below in provenance event in attributes tab line i, John, $100 ii, Kevin, $150 iii, Steve, $200 line.0 i, John, $100 ii, Kevin, $150 iii, Steve, $200 line.1 i, John, $100 ii, Kevin, $150 iii, Steve, $200 Expected output line i, John, $100 line.0 ii, Kevin, $150 line.1 iii, Steve, $200 Please suggest. ... View more

Wonderful Now it's ok Simon ... View more