Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Scaling GetHbase processor to fetch data faster
Labels:
- Labels:
-
Apache HBase
-
Apache NiFi
New Contributor
Created 11-25-2022 08:11 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am trying to Fetch 50 TB of Hbase table using the GetHbase processor. Where I have 3 Node Nifi cluster(15 GB RAM) where i see I can Merge hbase record and put the record faster but as I cannot increase concurrent task in GetHbase processor this is fetching data slow I see that fetching the 400 GB data has taken 35 Hours. Where I have network bend-width is 1 GB/s. and data cardinality is low.
so how can I fetch the data faster to meet SLA ?
0 REPLIES 0
