Member since
06-23-2018
9
Posts
0
Kudos Received
0
Solutions
02-26-2021
02:15 AM
Agreed, but is there a way to avoid this wastage. apart from migrating data to LFS and then again to HDFS. Example: We have a 500MB file with block size 128 MB i.e. 4 blocks on HDFS. Now since we changed block size to 256MB, how would we make the file on HDFS to have 2 blocks of 256MB instead of 4. Please suggest.
... View more
12-11-2018
04:51 AM
Yes I have already checked the logs as you have mentioned and nothing specific I can point out to this behavior. Have not taken thread dump but checked with diff and there seems to be some deployment of nar file but can't say specifically if that causes this. Anyway I have not faced it after that and incase if I face the same issue again I will follow your recommendations. Thanks for your help and support Matt.
... View more
12-17-2018
06:55 AM
@Geoffrey Shelton Okot What you have mentioned is for any specific path. Do you have any procedure through which we can change the block size of existing cluster which includes all old files ? Please post it here if any you are aware!!
... View more
06-25-2018
02:29 PM
If I create a new template, it is creating a flow.xml.gz and working fine. However If I replace the flow.xml.gz with old flow.xml.gz (one backup taken earlier in same cluster node HDF2.X) nifi UI is not coming after login and giving error as "com.sun.jersey.api.client.ClientHandlerException:
java.net.SocketTimeoutException: Read timed out". Have tried with all parameter tuning as described by "Matt Clarke" in some other post but no results. Again If I move old file and replace with new flow.xml.gz then nifi is working fine. Please let me know if anyone faces such issues and probable reason and working around. Thanks, Suman
... View more