- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Nifi - PutSQL Row length exception for Phoenix Upsert
- Labels:
-
Apache NiFi
-
Apache Phoenix
Created ‎10-18-2016 09:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
phoenix-upsert-error.pngNifi putsql is working fine ,suddenly i am getting Row length exception for Phoenix Upsert . There is no junk data , there is no syntax error also .
ERROR : PUTSQL failed to process due to java.lang.illegalArgumentException; Row length 43125 > 32767 .
i observed that leftside(32767) values is constant .
PFA
Created ‎10-19-2016 05:59 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It appears that this is a hard-coded check in the client side HBase Mutation class. I would recommend that you consider why you are creating such a large rowKey in the first place. There is some reading you could also do on the subject: http://hbase.apache.org/book.html#keysize
Created ‎10-18-2016 10:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
hbase has a MAX_ROW_LENGTH value of 32767
Created ‎10-18-2016 10:33 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The same upsert command I am executing in phoenix console , its working . but from putSql, it is throwing above error. Thanks
Created ‎10-31-2016 02:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is MAX_ROW_LENGTH belong to to only key or whole row which consists of all columns ??
Created ‎10-31-2016 03:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Just the row component of the Key: http://hbase.apache.org/book.html#_row
Created ‎10-31-2016 03:29 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you . I am refering this link https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/HConstants.html#MAX_ROW_LENGTH
what i understood is MAX_ROW_LENGTH is about whole row not only key . Here is my confusion , how can i take this property is only belongs to key ?
Created ‎10-19-2016 05:59 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It appears that this is a hard-coded check in the client side HBase Mutation class. I would recommend that you consider why you are creating such a large rowKey in the first place. There is some reading you could also do on the subject: http://hbase.apache.org/book.html#keysize
