In Nifi, There is a bootstrap.conf file inside the conf folder.  You can update the value of the following properties, # JVM memory settings java.arg.2=-Xms2g  java.arg.3=-Xmx8g https://community.cloudera.com/t5/Community-Articles/How-to-address-JVM-OutOfMemory-errors-in-NiFi/ta-p/244431  ... View more

If the input is text data, its better to write a java utility which reads line by line, applies all the rules & re-writes it as four column as per conversion required. Then load that new file into hive to query it. It will be cumbursome to do it in sql, as it needs another case statement inside case statement to validate the length of the split. ... View more

@Harsh J is there a way to avoid giving the column names manually...   beacuse I have 150 columns per table and more than 200 tables which is a huge number. ... View more