Hi Everyone, I’m Sachin Duggal, and I manage a bag manufacturing business. I’m currently exploring HDFS data recovery methods and have come across a question: Is it possible to recover HDFS data using only the block data? If you’ve dealt with something similar or have any suggestions on how this could be done, I’d love to hear your thoughts. Thank you in advance, Sachin Duggal ... View more

Hello Team, I am Sachin Duggal , and I am the owner of a bags manufacturing business. I am encountering an “Out of memory heap” error while processing a large text file (26k+ rows) through SFTP. The file contains | separated values, and I'm using the following processors for data manipulation. However, the process halts after the splitJSON processor. Has anyone else faced a similar issue or has any suggestions on how to optimize the memory usage or address this issue? I would appreciate any insights or alternative approaches that could help resolve this. Looking forward to your suggestions! Sachin Duggal            ... View more