@mala_etl Check out this feature in FetchSFTP:     It allows you to move the files into a new directory after fetching them. ... View more

Ahh that certainly is a different challenge which would require a slightly different approach.  My best recommendation, outside of making your own processors,  would be a combination of api calls to prepare variables for a processor group that uses listsftp and fetchsftp or getsftp once the variables are setup.    ... View more

@mbraunerde Before GetSFTP, you need this processor first:   ListSFTP    ListSFTP will send GetSFTP the the list of files to get.  Be sure to search in your NiFi Processor window, SFTP, to see all matching processors.  This works for any keyword, and I use it often.   Docs here:  https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.16.0/org.apache.nifi.processors.standard.ListSFTP/index.html     ... View more

@Nifi_Al  Use getFile/putFile to read and write in your flow.  Then If you use unpackContent against a zipped flowfile it should create individual artifacts flowfiles which can be additionally unzipped further.   Alternatively, if you can create a script to unzip recursively, you can use nifi to executeScript. Maybe even use executeProcess too. ... View more

@azg  Yes, just add the values you want in the processor configuration tab.  Click + to add new key/value pairs. ... View more

@bdworld2 Being that HDP is EOL (End of Life) and M1 chip is new and breaking anything with linux amd/64 I would recommend a different learning path.  Check out CDP and build new clusters to learn the asf components you are familiar with from HDP.     ... View more

@kumsath Yes, when i saw your post I started digging around too.  The issue here is number manipulation and type casting a "number" versus a "string". That easy gets complicated in attributes and with nifi expression language functions.   The solution i referenced would take the "number" and make a number in which the visual representation should then be correct.  Its worth a try since that execute script should be very easy to test.    The alternative is to do your "math" upstream or in an execute script processor not in updateattribute. ... View more

@RamaS Check out this documentation:   https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/replication-manager/topics/rm-dc-backup-and-disaster-recovery.html   Cloudera Manager provides an integrated, easy-to-use management solution to enable data protection on the Hadoop platform. Replication Manager enables you to replicate data across data centers for disaster recovery scenarios. Replications can include data stored in HDFS, data stored in Hive tables, Hive metastore data, and Impala metadata (catalog server metadata) associated with Impala tables registered in the Hive metastore. When critical data is stored on HDFS, Cloudera Manager helps to ensure that the data is available at all times, even in case of complete shutdown of a data center.   ... View more