@YasBHK HDP is no longer supported, there will be no releases and no upgrades.   I highly recommend not solutioning or training on the HDP Sandbox.   I would recommend that you investigate the modernized alternatives to HDP, such as CDP Private Cloud Base or CDP Public Cloud. ... View more

@udayabaski, as @steven-matison mentioned, the best solution would be to use the Distributed Map Cache. In order to implement it, you can follow these steps to initialize your Server: https://stackoverflow.com/questions/44590296/how-does-one-setup-a-distributed-map-cache-for-nifi/44591909#44591909   Now, regarding the way you want to incorporate it in your flow, I would suggest the following: - right after UpdateAttribute, you activate the PutDistributedMapCache. Within the processor, you will set the desired attribute at the property Cache Entry Identified. - Before InvokeHTTP, you add a FetchDistributedMapCache with which you extract the value for your key:value pair. All you have to do next is to extract your attribute to further use in your invokeHTTP.   It is as simple as that and you do not need any fancy configurations 🙂 ... View more

@swanifi, Have any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  ... View more

Yes, I am doing the same. And how to maintain the order of the dynamic properties in Invokehttp processor as the order is also important else it is saying bad request. Whenever i am adding those, these are automatically arranging the alphabetical orders instead the order on which i am adding  ... View more

yeah. I tried that but still same issue ... View more

@Fahmihamzah84 This appears to be an issue with your schema.  The BigQuery error is suggesting an issue trying to cast a string into a collection (array/list/ect).   It's hard to tell which array may be causing the issue as there are many.   My suggestion is to set the processor to log level DEBUG and see if you can get more verbose error.   This will help you figure out which field or fields is the culprit.      Keep in mind it could be one of the empty arrays too.     I do not suggest the following as a solution just as path to figuring out where the problem is.  Sometimes when i have issues with type casting,  i make everything a string temporarily and for development.  If you do this carefully one at a time, when the error goes away, you can determine which field it is.   This also helps you identify a working state for your flow and allow you to work from that operational base to find solution for the end schema being the format you need. ... View more

@anton123 Please check these references, there is important information here that everyone needs to master in order to work with ExecuteScript: https://community.hortonworks.com/articles/75032/executescript-cookbook-part-1.html https://community.hortonworks.com/articles/75545/executescript-cookbook-part-2.html https://community.hortonworks.com/articles/77739/executescript-cookbook-part-3.html   Some suggestions: Make sure you have all the imports you need Make sure you are using the correct variable names for "filter".  You have this defined but its not used. ... View more