import a large table from hive in nifi using SelectHiveQl

[#1]

I want to import large table in nifi from hive . I am trying using SelectHiveQL but the processor gets stuck as the data volume is around 280 million rows .

[#2]

Hi,

You want to extract those entire 280 millions in a single call ? not a good idea ! I suggest you loop thru it using the table partition + bucket keys(for better query response on Hive).

What is you table construct ?

Based on this you can run SelectHiveQL in parallel or sequentially thru a loop.

A once extract won`t do.

Thx