question Re: Nifi JsonSplit Doesn't Work in Archives of Support Questions (Read Only)

Nifi JsonSplit Doesn't Work

celalettin1286 — Mon, 19 Aug 2019 11:47:01 GMT

I'am using splitjson for splitting json.

After that i am using convertJsonToSql and putsql but nifi only puts last json part of the splitted jsons. I want to insert all parts.

Do you have any idea why i can't do that. Thanks.

source json:

 {
  "endorsement" : 59.9,
  "eventId" : "c54902db-50de-4dbd-b908-4317981931fc",
  "categoryId" : "1000230",
  "createDate" : "2016-08-18T10:15:00.361Z",
  "buyerId" : "4748764",
  "channel" : "MOBILE_IOS",
  "city" : "Bursa"
}, {
  "endorsement" : 13.11,
  "eventId" : "c54902db-50de-4dbd-b908-4317981931fc",
  "categoryId" : "1000491",
  "createDate" : "2016-08-18T10:15:00.361Z",
  "buyerId" : "4748764",
  "channel" : "MOBILE_IOS",
  "city" : "Bursa"
} ]

after split json there are two jsons:

Re: Nifi JsonSplit Doesn't Work

bbende — Thu, 18 Aug 2016 00:04:46 GMT

Can you provide an example JSON document that is not splitting correctly?

Re: Nifi JsonSplit Doesn't Work

jts — Thu, 18 Aug 2016 00:47:00 GMT

Could you provide an example of the json you're trying to split, and what is in some of the resulting flowfiles after the SplitJson processor? I suspect that the JsonPath being used might not be splitting the json the way you want.

Re: Nifi JsonSplit Doesn't Work

celalettin1286 — Thu, 18 Aug 2016 01:01:17 GMT

Splitting is done correctly. I am watching al the processes till Last process.putsql processes passes insert sql statements according to data provenance.

But still last json part as a record is inserted all the time.

Re: Nifi JsonSplit Doesn't Work

mburgess — Thu, 18 Aug 2016 08:44:14 GMT

ConvertJSONtoSQL expects the JSON object (to be converted to an INSERT/UPDATE statement) to be in the flow file content, not the attributes. Between your SplitJson and your ConvertJSONtoSQL you have a couple of processors like EvaluateJsonPath and AttributesToJSON. What is your configuration for AttributesToJSON? What does that last UpdateAttribute processor do before it goes to ConvertJSONtoSQL? If you could share a template (perhaps a scrubbed version to remove your server-specific information?) that would be helpful as well.

Re: Nifi JsonSplit Doesn't Work

celalettin1286 — Mon, 19 Aug 2019 11:46:42 GMT

because of the attachment limit i continue with this message:

two splitted json:

two putsql queryy:

Re: Nifi JsonSplit Doesn't Work

celalettin1286 — Thu, 18 Aug 2016 20:42:18 GMT

i found the problem.

Reason was the hbase, i am sending same values as key so, it is impossible. After changing key values, everything working fine.

Thanks