<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: NiFi JVM settings for large files. in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/NiFi-JVM-settings-for-large-files/m-p/232749#M194584</link>
    <description>&lt;P&gt;&lt;A rel="user" href="https://community.cloudera.com/users/363/bbende.html" nodeid="363" target="_blank"&gt;@Bryan Bende&lt;/A&gt;,&lt;/P&gt;&lt;P&gt;Thanks for your inputs Bryan.&lt;/P&gt;&lt;P&gt;This huge JSON file (22gb) we got needs to be cleaned up, while we notified source about the issue and asked them to cleanup before they send it us. i was trying to see if i can use NiFi to fix it. &lt;/P&gt;&lt;P&gt;as it is this file is not opening in any json viewers or reporting tools as it has white spaces between integers.&lt;/P&gt;&lt;P&gt;For ex look at second Customer_Id record where it has id as 436 796&lt;/P&gt;&lt;P&gt;[{"Customer_Id":236768,"Brand":[{"Brand_Nm":"abcc","Question":[{"Question_Txt":"The type of food prefers is ...","Answer":[{"Answer_Txt":"Combination of Both","Response":[{"Response_Dt":"2017-04-10T18:33:40"}]}]},{"Question_Txt":"My favorite is ...","Answer":[{"Answer_Txt":"Over 17 years old","Response":[{"Response_Dt":"2016-12-07T03:43:57"}]}]}]}]},{"Customer_Id":436  796,"Brand":[{"Brand_Nm":"edfr","Question":[{"Question_Txt":"At the end of the day I am greeted with ...","Answer":[{"Answer_Txt":"kisses","Response":[{"Response_Dt":"2017-04-12T01:54:12"}]}]}]}]}&lt;/P&gt;&lt;P&gt;I am trying to read this as text file and replace those..i used the simple getFile--&amp;gt;ReplaceText--&amp;gt;PutFile processors to do it on a 150MB file which worked fine and took a couple of minutes. I am just being cautious with the big file.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="64439-replacetext.jpg" style="width: 601px;"&gt;&lt;img src="https://community.cloudera.com/t5/image/serverpage/image-id/14810i679B25E59A00EF4B/image-size/medium?v=v2&amp;amp;px=400" role="button" title="64439-replacetext.jpg" alt="64439-replacetext.jpg" /&gt;&lt;/span&gt;&lt;/P&gt;</description>
    <pubDate>Sun, 18 Aug 2019 00:22:32 GMT</pubDate>
    <dc:creator>saikrishna_tara</dc:creator>
    <dc:date>2019-08-18T00:22:32Z</dc:date>
  </channel>
</rss>

