question replacing blank lines in a file using a efficeint approach in Support Questions

replacing blank lines in a file using a efficeint approach

dhieru — Sun, 18 Aug 2019 09:18:50 GMT

Hi All,

Thanks a lot this awesome community. I using replace text processor and I used the apporaches such as desribed in these 2 links below

https://community.hortonworks.com/questions/147405/replacing-new-lines-weird-behavior-observed.html

https://community.hortonworks.com/questions/147226/replacetextprocessor-remove-blank-lines.html

this consumes a lot of heap space and need something efficient, @Matt Clarke suggested to use shown in picture.

Now I am using

Evaluation mode as Line by line

Search regex as ^ (new line shift+enter) $

What should be my replacement value?

since there are no groups formed there?

Any help or suggestions?

Thanks a lot

Re: replacing blank lines in a file using a efficeint approach

Shu_ashu — Sun, 18 Aug 2019 09:18:42 GMT

@dhieru singh

I think just add capture all after $ as shown below screenshot will work.

Search Value

^ 
$(.*)

Replacement Value

$1

Replacement Strategy

Regex Replace

Evaluation Mode

Line-by-Line

Replace Text Configs:-

Re: replacing blank lines in a file using a efficeint approach

dhieru — Sun, 18 Aug 2019 09:18:34 GMT

@Shu Thanks for the response. However it still did not removed the blank lines. Attached is the image,

and after applying replacetext processor it still looked the same

Any idea or help?

Thanks

Dheeru

Re: replacing blank lines in a file using a efficeint approach

Shu_ashu — Sun, 18 Aug 2019 09:18:21 GMT

@dhieru singh

Can you once make sure the search value property having no spaces in it.

Search Value

^//no space
$(.*)//no space

Configs:-

Compare your Replace Text processor configs with above screenshot configs and don't keep any spaces after ^ and $(.*) in search value property and Rerun the processor.

If you are still having issues please attach your input file contents...!!

Re: replacing blank lines in a file using a efficeint approach

dhieru — Thu, 04 Jan 2018 12:28:58 GMT

@Shu it worked Thanks a lot appreciate your help!!!. Apologies for the silly mistake, there was a space on the first line

Thanks again