Hey there, I'm trying to query an Avro record with the QueryRecord processor. The Avro gets created with a ExecuteSQL processor. The output of the ExecuteSQL seems fine and I can convert it in e.g. JSON without any problems. But when I try to query it I get a NullPointerException. Anyone able to help me with the problem? QueryRecord queryrecord.png AvroReader avroreader.png AvroRecordSetWriter avrorecordsetwriter.png Exception in the QueryRecord processor 2018-07-24 14:27:37,277 ERROR [Timer-Driven Process Thread-4] o.a.nifi.processors.standard.QueryRecord QueryRecord[id=ac799474-0164-1000-ffff-ffffc83bf6e1] Unable to query StandardFlowFileRecord[uuid=78d37332-b122-4433-b16d-099757d8d839,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1532435241579-3, container=default, section=3], offset=0, length=108732158],offset=0,name=6117269883610207,size=108732158] due to java.lang.NullPointerException: {} java.lang.NullPointerException: null at Baz$5$1.current(Unknown Source) at org.apache.calcite.linq4j.Linq4j$EnumeratorIterator.next(Linq4j.java:672) at org.apache.calcite.avatica.util.IteratorCursor.next(IteratorCursor.java:46) at org.apache.calcite.avatica.AvaticaResultSet.next(AvaticaResultSet.java:227) at org.apache.nifi.serialization.record.ResultSetRecordSet.<init>(ResultSetRecordSet.java:51) at org.apache.nifi.processors.standard.QueryRecord$1.process(QueryRecord.java:313) at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2571) at org.apache.nifi.processors.standard.QueryRecord.onTrigger(QueryRecord.java:306) at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1124) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) ... View more

Hey there, I want to configure a data flow where I load new data as they get saved in a postgres database. For that I want to use the timestamp column in the GenerateTableFetch processor as maximum value column. Sadly the processor is not able to generate the right sql statements. Unable to execute SQL select query SELECT COUNT(*), MAX(time) time FROM log_table due to ERROR: syntax error at or near "time" It seems to have a problem with the alias, as would need the 'as' statement in postgres, but it seems to use no alias statement at all and fails because of this. Is there a way to fix that? Any help would be appreciated. Best regards, Markus ... View more

Hey there, I'm currently trying to read files from the HDFS in the HDP cluster where NiFi is running (with HDF management pack). Is there a way that HDFS processors automatically get the configuration for core-site, hdfs-site and kerberos, without having to configure them every time I'm using the HDFS processors? Best regards, Markus ... View more

Hey there, currently trying to configure KnoxSSO authentication for NiFi. Sadly NiFi doesn't redirect to the KnoxSSO login site. The SSO part should work, because I'm already using it for the Ambari login. # Apache Knox SSO Properties # nifi.security.user.knox.url=https://knoxgateway.local:8443/gateway/knoxsso/api/v1/websso nifi.security.user.knox.publicKey=/certs/nifi/knox.pem nifi.security.user.knox.cookieName=hadoop-jwt nifi.security.user.knox. Above is the relevant properties I configured. I didn't find anything else to do in the installation guide. Sadly there aren't any errors, so I really don't know where to go from here. Is there any configuration I may missed which is required for the redirect? Best regards, Markus ... View more

Hey there, I'm trying to kerberize my cluster. I installed Kerberos 5 server following this guide. Everything there seemed to work. After that I tried to kerberize my cluster following the official documentation, but it fails after testing the Kerberos clients with the following error: 500 status code received on POST method for API: /api/v1/clusters/BIKW/requests Error message: An internal system exception occurred: Failed to execute the command: Broken pipe Sadly I couldn't find another post where someone had a similar problem. I attached the log with the complete error stack. ambari-server.zip I would appreciate any help. Best regards, Markus ... View more