I want to import large table in nifi from hive . I am trying using SelectHiveQL but the processor gets stuck as the data volume is around 280 million rows .
You want to extract those entire 280 millions in a single call ? not a good idea ! I suggest you loop thru it using the table partition + bucket keys(for better query response on Hive).
What is you table construct ?
Based on this you can run SelectHiveQL in parallel or sequentially thru a loop.
A once extract won`t do.