Hi, I am going to convert the result of Nifi ExecuteSQL procecessor and save the result as putparquet into hdfs. Any suggestion on how to convert avro format (result of executesql) to parquet using putparquet ? I will use avroreader in putparquet processor, but it requires Schema Registry. could I auto generate the Schema Registry of the result from executesql.? Thanks Andy ... View more

Could NIfi Nifi - executeSQL process run sql to join two Databases? ... View more

My servers was auto reboot yesterday, and I cannot start Nifi. Any suggestion to solve this issue? Thanks Andy I got the following error: Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flowController': FactoryBean threw exception on object creation; nested exception is java.lang.IllegalArgumentException: No enum constant org.wali.UpdateType. at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:175) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103) ~[na:na] at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1585) ~[na:na] at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:254) ~[na:na] at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) ~[na:na] at org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1060) ~[na:na] at org.apache.nifi.spring.StandardFlowServiceFactoryBean.getObject(StandardFlowServiceFactoryBean.java:48) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ~[na:na] ... 33 common frames omitted Caused by: java.lang.IllegalArgumentException: No enum constant org.wali.UpdateType. at java.lang.Enum.valueOf(Enum.java:238) ~[na:1.8.0_101] at org.wali.UpdateType.valueOf(UpdateType.java:24) ~[na:na] at org.apache.nifi.controller.state.StateMapSerDe.deserializeRecord(StateMapSerDe.java:76) ~[na:na] at org.apache.nifi.controller.state.StateMapSerDe.deserializeEdit(StateMapSerDe.java:69) ~[na:na] at org.apache.nifi.controller.state.StateMapSerDe.deserializeEdit(StateMapSerDe.java:30) ~[na:na] at org.wali.MinimalLockingWriteAheadLog$Partition.recoverNextTransaction(MinimalLockingWriteAheadLog.java:1072) ~[na:na] at org.wali.MinimalLockingWriteAheadLog.recoverFromEdits(MinimalLockingWriteAheadLog.java:459) ~[na:na] at org.wali.MinimalLockingWriteAheadLog.recoverRecords(MinimalLockingWriteAheadLog.java:301) ~[na:na] at org.apache.nifi.controller.state.providers.local.WriteAheadLocalStateProvider.init(WriteAheadLocalStateProvider.java:99) ~[na:na] at org.apache.nifi.controller.state.providers.AbstractStateProvider.initialize(AbstractStateProvider.java:34) ~[na:na] at org.apache.nifi.controller.state.manager.StandardStateManagerProvider.createStateProvider(StandardStateManagerProvider.java:189) ~[na:na] at org.apache.nifi.controller.state.manager.StandardStateManagerProvider.createLocalStateProvider(StandardStateManagerProvider.java:81) ~[na:na] at org.apache.nifi.controller.state.manager.StandardStateManagerProvider.create(StandardStateManagerProvider.java:67) ~[na:na] at org.apache.nifi.controller.FlowController.<init>(FlowController.java:469) ~[na:na] at org.apache.nifi.controller.FlowController.createStandaloneInstance(FlowController.java:375) ~[na:na] at org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:74) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ~[na:na] ... 40 common frames omitted 2017-09-11 10:21:10,334 INFO [Thread-2] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise). ... View more

Hi, My Nifi UI is down On the nifi-bootstrap log, I found the OutOfMemoryError. Any advice on this issue is appraciated. Thanks, Andy here is the nifi-bootstrap log: 2017-05-13 02:55:41,053 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2017/05/13 02:55:41 - please wait. 2017-05-13 02:55:41,054 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0001.phd' in response to an event 2017-05-13 02:55:48,525 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Heap dump written to /app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0001.phd 2017-05-13 02:55:48,529 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested System dump using '/app/Project/nifi-1.1.1/core.20170513.025541.31792.0002.dmp' in response to an event 2017-05-13 02:55:56,811 ERROR [NiFi logging handler] org.apache.nifi.StdErr Warning: unable to move dump to "/app/Project/nifi-1.1.1/core.20170513.025541.31792.0002.dmp" across file systems (check kernel core_pattern). Using alternate file location "/var/core/core.20170513.025541.31792.0002.dmp" 2017-05-13 02:55:56,818 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I System dump written to /var/core/core.20170513.025541.31792.0002.dmp 2017-05-13 02:55:56,818 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Java dump using '/app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0003.txt' in response to an event 2017-05-13 02:55:56,971 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Java dump written to /app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0003.txt 2017-05-13 02:55:56,972 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Snap dump using '/app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0005.trc' in response to an event 2017-05-13 02:55:56,972 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Snap dump written to /app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0005.trc 2017-05-13 02:55:56,973 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError". 2017-05-13 02:55:56,974 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0004.phd' in response to an event ... View more