Hi  I have the next JSON   { "model": "2002", "cars_drivers" : [ { "id" : "1", "name" : "Mick", "is_processed" : 0 }, { "id" : "2", "model" : "John", "is_processed" : 0 }}   and I have 2 attributes attr_id =  1 attr_name = Mick   I want to update is_processed in cars_drivers to 1 if the id = attr_id  and name = attr_name   So the expected result will be      { "model": "2002", "cars_drivers" : [ { "id" : "1", "name" : "Mick", "is_processed" : 1 }, { "id" : "2", "model" : "John", "is_processed" : 0 }}     ... View more

Hi    I have a flow file with text content  I want to remove the last line out of this content    Input example :- Aaa Bbb Ccc Footer   Expected output:- Aaa Bbb Ccc   How I can accomplish this?     ... View more

Hi   I have a flow file with huge string content and I want to create a JSON and add this string to the JSON as a value with a static key.   Example Flow file string content: "Example string" Needed output :{"Static key":"Example string"}   I tried to add the string content to the flow file attribute using ExtractText and use attribute to JSON processor to generate the needed output but I have 2 issues with this approach:- 1- The string content size is not under my control and I dont know how much I need to configure the Maximum Buffer Size and Maximum Capture Group Length. 2- Adding the content to the flow file attribute will duplicate the flow file size and this will impact the performance. 3- Finally I feel it is a workaround solution :))   Is there any other way to solve this issue?   ... View more

Hello   I have a spark cluster on CHD 6.3.3 1 master node and 3 worker nodes I will read huge data from external RDBMS”mssql” using jdbc driver  And I need to open the port in the firewall My external RDBMS port is 99766 But my problem is what port should I open from the spark side for each node so I can read and write data using the master and all workers in my spark application.   Thank you  ... View more

Hello I want to build batch-based ETL from RDBMS "SQL Server" Using apache spark . My Spark cluster is running part of the Cloudera Application. My question is Where should I store the ETL job watermark for example the maximum TIMESTAMP so the next job will get the records which have a bigger timestamp in the next batch run? Should I use a Hive table Or there is a better approach to store this data so it can be used in the next jobs? ... View more