Hi, I am trying to consume a file from UNIX folder using NiFi FetchFile processor by providing UNIX folder location and the filename. The FetchFile processor only fetches the file with the matching filename which is not case agnostic. If I provided FetchFile with filename as abc.txt and I drop ABC.TXT in the UNIX location, the FetchFile processor will not pick it up. Is there any way I can pickup files based on case agnostic filenames? Note: I tried using the GetFile processor but it only has success relationship which means that GetFile processor will not handle the negative scenario when the file is not present when expected which is not as per my requirement. Any help will be appreciated. Thanks ... View more

Hi, When I try to install an instance of NiFi, I am able to start NiFi but to configure any flows in the canvas, I have to set the component level access policies on the canvas and provide the admin and users with rights to view/modify component and data. Only after setting this access policies, I am able to configure any flows or else I getting an error saying: HTTP/1.1 403 Forbidden: No applicable policies could be found. Contact the system administrator. This is understandable since the UUID of the NiFi canvas change with every fresh installation of NiFi (since flow.xml.gz changes). My question is, can the access policies be set using NiFi REST API for the canvas rather than manually adding the users via UI. I want to build a UNIX script with set of commands that uses nifi-api to set the access policies so that I can run this script and then configure the flows. Is it possible to set access policies using nifi-api? If so, how? Thanks and Regards, Harish Vaibhav Kali ... View more

@Matt Clarke @Felix Albani Hi Matt/Felix, If suppose I have 5 process groups in a NiFi flow and I am adding a processor in one of the process group, does this change the UUIDs of all processors in that NiFi flow? The reason I am asking this is because, I am using GIT to maintain XMLs of NiFi flows, when I make a change and raise a pull request against master branch, I see that the UUIDs of all processors in the entire flow changes. If another person at the same time makes a change to a processor(on a different instance of NiFi) and raises a pull request against master branch there will be a conflict. So as to avoid this, one has to make their changes and once they are merged to master branch, the other person needs to get the latest changes in master branch and then work on his/her change. Is there anyway we can avoid this? ... View more

Hi, I am trying to stop a nifi process group from UNIX where the nifi is installed using curl command. First I generated the access token to the URL that I am trying to POST by running the below command: curl --tlsv1.2 https://localhost:9966/nifi-api/access/token --data 'username=*****&password=****' -k After this, I am running the below command using the access token generated from above step: curl --tlsv1.2 -ik -H 'Content-Type: application/json' -H 'Authorization: Bearer {token from above command}' -XPUT -d'{"id":"03bc6708-6a44-4069-8fe3-77ec056639e7","state":"STOPPED"}' https://localhost:9966/nifi-api/flow/process-groups/03bc6708-6a44-4069-8fe3-77ec056639e7 But I get the below error when I run the above command: Can someone help me resolve this issue? Am I running the correct commands? If not can someone give me the correct commands to GET/POST NiFi content using curl command PS: I am able to access NiFi UI through my web browser using this link: https://nifi-host:port/nifi ... View more

Hi, I am trying to upgrade NiFi to version 1.5.0 from 0.6.1. I have downloaded HDF 3.1.1 and updated the Apache NiFi JARs to version 1.5.0 in my application. When I try to start/load NiFi, I get below Java security exception: 2018-06-11 15:18:08,046 WARN [main] org.eclipse.jetty.webapp.WebAppContext Failed startup of context o.e.j.w.WebAppContext@1f628b31{/nifi-api,file:///*****/*****/NiFi/dev.2018-06-11-1515/nifi-1.5.0.3.1.1.0-35/work/jetty/nifi-web-api-1.5.0.3.1.1.0-35.war/webapp/,UNAVAILABLE}{./work/nar/framework/nifi-framework-nar-1.5.0.3.1.1.0-35.nar-unpacked/META-INF/bundled-dependencies/nifi-web-api-1.5.0.3.1.1.0-35.war} org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller. at org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:88) at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:876) at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:532) at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:839) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:344) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1480) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1442) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:799) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:261) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:540) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:290) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) at org.eclipse.jetty.server.Server.start(Server.java:452) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.Server.doStart(Server.java:419) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:777) at org.apache.nifi.NiFi.<init>(NiFi.java:160) at org.apache.nifi.NiFi.main(NiFi.java:268) Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flowService': FactoryBean threw exception on object creation; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flowController': FactoryBean threw exception on object creation; nested exception is org.apache.nifi.framework.security.util.SslContextCreationException: java.io.IOException: exception decrypting data - java.security.InvalidKeyException: Illegal key size at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:175) at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103) at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1634) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:317) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1084) at org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:55) ... 32 common frames omitted Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flowController': FactoryBean threw exception on object creation; nested exception is org.apache.nifi.framework.security.util.SslContextCreationException: java.io.IOException: exception decrypting data - java.security.InvalidKeyException: Illegal key size at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:175) at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103) at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1634) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:317) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1084) at org.apache.nifi.spring.StandardFlowServiceFactoryBean.getObject(StandardFlowServiceFactoryBean.java:48) at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ... 38 common frames omitted Caused by: org.apache.nifi.framework.security.util.SslContextCreationException: java.io.IOException: exception decrypting data - java.security.InvalidKeyException: Illegal key size at org.apache.nifi.framework.security.util.SslContextFactory.createSslContext(SslContextFactory.java:106) at org.apache.nifi.controller.FlowController.<init>(FlowController.java:478) at org.apache.nifi.controller.FlowController.createStandaloneInstance(FlowController.java:409) at org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:77) at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ... 45 common frames omitted Caused by: java.io.IOException: exception decrypting data - java.security.InvalidKeyException: Illegal key size at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.cryptData(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineLoad(Unknown Source) at java.security.KeyStore.load(KeyStore.java:1445) at org.apache.nifi.framework.security.util.SslContextFactory.createSslContext(SslContextFactory.java:86) ... 49 common frames omitted 2018-06-11 15:18:08,861 INFO [main] o.e.j.a.AnnotationConfiguration Scanning elapsed time=546ms 2018-06-11 15:18:08,865 INFO [main] o.e.j.C./nifi-content-viewer No Spring WebApplicationInitializer types detected on classpath 2018-06-11 15:18:08,903 INFO [main] o.e.jetty.server.handler.ContextHandler Started o.e.j.w.WebAppContext@1a8b7423{/nifi-content-viewer,file:///*****/*****/NiFi/dev.2018-06-11-1515/nifi-1.5.0.3.1.1.0-35/work/jetty/nifi-web-content-viewer-1.5.0.3.1.1.0-35.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.5.0.3.1.1.0-35.nar-unpacked/META-INF/bundled-dependencies/nifi-web-content-viewer-1.5.0.3.1.1.0-35.war} 2018-06-11 15:18:08,905 INFO [main] o.e.jetty.server.handler.ContextHandler Started o.e.j.s.h.ContextHandler@283693af{/nifi-docs,null,AVAILABLE} 2018-06-11 15:18:08,953 INFO [main] o.e.j.a.AnnotationConfiguration Scanning elapsed time=26ms 2018-06-11 15:18:08,956 INFO [main] o.e.jetty.ContextHandler./nifi-docs No Spring WebApplicationInitializer types detected on classpath 2018-06-11 15:18:08,994 INFO [main] o.e.jetty.server.handler.ContextHandler Started o.e.j.w.WebAppContext@695dc0e6{/nifi-docs,file:///*****/*****/NiFi/dev.2018-06-11-1515/nifi-1.5.0.3.1.1.0-35/work/jetty/nifi-web-docs-1.5.0.3.1.1.0-35.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.5.0.3.1.1.0-35.nar-unpacked/META-INF/bundled-dependencies/nifi-web-docs-1.5.0.3.1.1.0-35.war} 2018-06-11 15:18:09,044 INFO [main] o.e.j.a.AnnotationConfiguration Scanning elapsed time=25ms 2018-06-11 15:18:09,047 INFO [main] org.eclipse.jetty.ContextHandler./ No Spring WebApplicationInitializer types detected on classpath 2018-06-11 15:18:09,079 INFO [main] o.e.jetty.server.handler.ContextHandler Started o.e.j.w.WebAppContext@1f5359a8{/,file:///*****/*****/NiFi/dev.2018-06-11-1515/nifi-1.5.0.3.1.1.0-35/work/jetty/nifi-web-error-1.5.0.3.1.1.0-35.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.5.0.3.1.1.0-35.nar-unpacked/META-INF/bundled-dependencies/nifi-web-error-1.5.0.3.1.1.0-35.war} 2018-06-11 15:18:09,102 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down. java.io.IOException: exception decrypting data - java.security.InvalidKeyException: Illegal key size at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.cryptData(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineLoad(Unknown Source) at java.security.KeyStore.load(KeyStore.java:1445) at org.eclipse.jetty.util.security.CertificateUtils.getKeyStore(CertificateUtils.java:52) at org.eclipse.jetty.util.ssl.SslContextFactory.loadKeyStore(SslContextFactory.java:998) at org.eclipse.jetty.util.ssl.SslContextFactory.load(SslContextFactory.java:252) at org.eclipse.jetty.util.ssl.SslContextFactory.doStart(SslContextFactory.java:219) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113) at org.eclipse.jetty.server.SslConnectionFactory.doStart(SslConnectionFactory.java:72) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113) at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:270) at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:81) at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:236) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.server.Server.doStart(Server.java:431) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:777) at org.apache.nifi.NiFi.<init>(NiFi.java:160) at org.apache.nifi.NiFi.main(NiFi.java:268) 2018-06-11 15:18:09,103 INFO [Thread-8] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2018-06-11 15:18:09,111 INFO [Thread-8] o.eclipse.jetty.server.AbstractConnector Stopped ServerConnector@73b82df3{SSL,[ssl, http/1.1]}{0.0.0.0:9990} 2018-06-11 15:18:09,111 INFO [Thread-8] org.eclipse.jetty.server.session Stopped scavenging NiFi starts fine when I start/load using 0.6.1 version but throws above exception when I start with version 1.5.0. I have checked for JCE JARs in /jre/lib/security folder and they are present but were installed long time ago(~2years ago). Can someone please help me on this? Any help is appreciated. Thanks ... View more