@JohnSilver Open the queue list between list/fetch and look at the content of flowfile (0.00 size).  Take the (i) or the (👁) in the list to go deeper.   Also inspect the attributes tab attached to the flowfile.  Looking for file names, path, etc...  those bits need to be parsed to fetchSMB as attributes, and then the right file will be fetched for putHDFS. ... View more

@kwanchai The error seems to indicate that postgres is not running.  If you can make sure that the postgres installed with the CDP is restarted and running then try again.   It is possible after reboot that is stuck in undesired state you see (shutting down).  Alternatively, redo the install and complete a shutdown of CDP completely before doing reboot and snapshot steps. ... View more

@JohnSilver A few advices:  In the future post screen shot of flow, and important processor configuration screen shots.  You can also share a flow definition file on github, and sample data so we can help see what you see.   Without those some advice is below.   It sounds like ListSMB is returning a list of all results( files and or paths).  Can you share that output?   (Run ListSMB once, inspect flowfile, share here in a code block).   Without seeing that I think another processor should iterate through that list flowfile contents, and fetch each file/path independently.   ... View more

@ibrooks Excellent article here.  I will definitely be using this in my CML Demos going foward.   I just sent a PR w/ some flow improvements you may like to use as well.   ... View more

@Sivaluxan Assuming Huawei OBS is s3 compliant( a quick search says it is), you should be able to use all of the S3/OBS based nifi processors.     You would just need to satisfy the access/auth requirements in order to connect from NiFi to H OBS from within the of the processors below.   https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.22.0/org.apache.nifi.processors.aws.s3.ListS3/index.html https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.22.0/org.apache.nifi.processors.aws.s3.FetchS3Object/index.html https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.11.4/org.apache.nifi.processors.aws.s3.PutS3Object/index.html     ... View more

@License Yes, a true DR Solution is a fully duplicated production cluster.  This requires the necessary licensing for all PROD and DR nodes. ... View more

@Aimen We will need to see screen shots of your flow, and the configuration for the s3 processor.  It also helps to share the exact error, etc.   Without this information, it is not possible to suggest solutions. ... View more