@Techie123  The ExecuteStreamCommand processor is working as designed: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.16.2/org.apache.nifi.processors.standard.ExecuteStreamCommand/index.html Executes an external command on the contents of a flow file, and creates a new flow file with the results of the command. You could route both the "original" and "output stream " relationships via the same outbound connection to a mergeContent processor which can merge the content from both source FlowFiles into a single FlowFile. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.16.2/org.apache.nifi.processors.standard.MergeContent/index.html   If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post. Thank you, Matt ... View more

@IslamGamal  Keep in mind that all the FlowFile attributes for a FlowFile are held in NiFi's JVM heap memory.  Creating large attributes on your FlowFiles can quickly eat up a lot of heap memory and affect JVM performance. Thanks, Matt ... View more

@Abhishek27Apple  Since you are not seeing anything in the NiFi log files... 1. Have you tried using a different web browser like Firefox? 2. Have you tried opening your browser's Developer tools and inspecting the actual rest-api call that was made when you attempt the various actions that fail from with the NiFi UI? 3. Are you going through a proxy or load balancer (is it configured to use sticky sessions?)? 4. Which Browser and version are you using? 5. Have you tried clearing your browser cache? 6. Does same behavior exist using an incognito window in your browser? 7. What java version is your NiFi using? Thank you, Matt ... View more

@Mridul_garg  Sharing the complete stack trace(s) from the nifi-app.log maybe be helpful in helping you here. When you say you changed the open file limits, what ddi you change it to? what does the output from "ulimit -a" show.  Make sure you run this command as the same user that owns your NiFi process. Thanks, Matt ... View more

@Abhishek27Apple  Something that strikes me as odd in the configuration file authorizers.xml you shared, I don't see the  managed-authorizer That provider would look like this and come after the file-user-group-provider and the file-access-policy-provider: <authorizer> <identifier>managed-authorizer</identifier> <class>org.apache.nifi.authorization.StandardManagedAuthorizer</class> <property name="Access Policy Provider">file-access-policy-provider</property> </authorizer> The nifi.properties file you shared is configured to use this authorizer. However, I would have expected NiFi to fail to start if this authorizer was really missing. Matt ... View more

@Abhishek27Apple  I don't see in your authorizations for your user where you have granted permissions for the root process group.  From the UI you will see an "Operate" panel on the left side of the canvas.  Within the "Operate" panel you will see the component currently selected and an icon that looks like a key.  With Nothing selected, it defaults to the root process group created when NiFi was started the very first time. Click on that key and add your user to the policies you want your user to have. By default these policies are not set for the admin as they are not needed by an admin.  These policies are typically used by developers who will be building dataflows on the canvas. You can find all the access policies in the embedded documentation within NiFi or from the Apache NiFi site: https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#access-policies If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post. Thank you, Matt   ... View more

@benjbenj  The ListenHTTP processor sets up a Listener on the configured port in the processor.  So there is not fetch involved in this flow design.  On your source NiFi, you would have a separate InvokeHttp processor for each unique MiNiFi agent you have deployed.  So while your data ingestion is setup on the same port on each unique MiNiFi, your invokeHTTP processors are each configured with a different target hostname.  When the invokeHTTP receive a FlowFile, it will connect to the http listener and transmit that FlowFile. Thanks, Matt ... View more

@nada  You can use the CompressContent processor to decompress gzip files. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.16.2/org.apache.nifi.processors.standard.CompressContent/index.html Set "Mode" to "Decompress", "compression format" to "gzip", and "Update Filename" to "True". If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post. Thank you, Matt   ... View more