@JonnyL    I would highly recommend that you back up and create a small 3 node nifi cluster to test this feature.  Putting 2 nifi on single node, does not satisfy the test cases you really want to be experimenting with.     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@ManuN Anyway you go about this task, you are going to have to execute the commands against the tables to get sizes.  With a large number of tables this should be a script, program, or process.   The common methods are to query the table with hive:   -- gives all properties show tblproperties yourTableName -- show just the raw data size show tblproperties yourTableName("rawDataSize")   Or the most accurate is to look at the table location in HDFS:   hdfs dfs -du -s -h /path/to/table   There are also some methods to try and get this data directly from the Hive Metastore, assuming the table is an internal Hive table.     In the past I have completed this with a basic bash/shell script.   I have also done similar in NiFI and prefer to do it like this without coding.     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@ang_coder  Depending on the number of unique values you need to add,  updateAttribute + expression language will allow you to create flowfile attribute based on the table results in a manner I would call "manually".   These can be used in routing or further manipulating the content (original database rows) according to your match logic.  For example with ReplaceText you can replace the original value with the original value + the new value.       Additionally during your flow you can programmatically change the results of the content of the flowfile to add the new column using the attribute from above, or with a fabricated query.  In the latter example you would use a RecordReader/RecordWriter/UpdateRecord on your data.  In a nutshell you create a translation on the content that includes adding the new field.    This is a common use case for nifi and there are many different ways to achieve it.     To have a more complete reply that better matches your use case,  you should provide more information, sample input data, the expected output data, your flow, a template of your flow, and maybe what you have tried already.      If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more