Hi Shu, Thanks for your advise. I think i missed one of the important step in your instruction. You are right, i want to flatten all the elements including elements of array. I decided to take two different options and for both i was not successful : 1- I tried to flattened all the attribute names which are not pert of array and so i used the attached Jolt Spec1.txt but then the result doesn't include gatewayMetaDataList and so i use EvaluateJsonPath for the array in the next step 2- I used "evaluateJsonPath" with destination of flowfile-attribute and then split json processor with JsonPathExpressionas $.gatewayMetaDataList" but i get the attached error. untitled.png Could you please advise which step i did wrong? Thanks, SJ ... View more

Hi, The issue is fixed. I had to delete the rest of the namenodes and just keep one. In HDFS config some of the parameters still pointing to the old servers. I have to replace them with the new server and stop/start all the services. slf4j-log4j error was misleading error and it was kinds of warning and not error. ... View more

Thanks Aditya, Didn't work. I also tried to add all of the following ones one by one but didn't work. slf4j-nop.jar slf4j-simple.jar slf4j-log4j12.jar slf4j-jdk14.jar logback-classic.jar ... View more

Hi Shu, I followed your advice. Please find the screenshot. On the green arrow I can get the whole message which is not flattened.. On the red one I get only the array one that I split and not all. untitled.png I add the following in the "attrbuteToJson" processor. applicationID,applicationName,nodeName,devEUI,mac,time,rssi,loRaSNR,name,latitude,longitude,altitude,tI-frequency,dRmodulation,dRbandwidth,dRspreadFactor,tI-adr,tI-codeRate,fCnt,fPort,data Any thoughts please? ... View more

Hi Yash, That's really great help. I followed your instructions and could flattened the Json format. Just have a quick question, since we are evaluate the message in two steps (arrays and not array one) how can I merge them together to make sure the full falttened Json message is created. ... View more

Hi Andrew, I've tried consumeMQTT too but the clientId was the issue. Thanks for your help. SJ ... View more