Member since
12-07-2017
23
Posts
2
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1586 | 07-26-2018 07:34 AM | |
1178 | 07-06-2018 08:26 AM |
07-26-2018
07:34 AM
Seems like a error in the SQL statement threw the NullPointerException. Not really the place I would have looked with this kind of error.
... View more
07-24-2018
12:46 PM
Hey there, I'm trying to query an Avro record with the QueryRecord processor. The Avro gets created with a ExecuteSQL processor. The output of the ExecuteSQL seems fine and I can convert it in e.g. JSON without any problems. But when I try to query it I get a NullPointerException. Anyone able to help me with the problem? QueryRecord queryrecord.png AvroReader avroreader.png AvroRecordSetWriter avrorecordsetwriter.png Exception in the QueryRecord processor 2018-07-24 14:27:37,277 ERROR [Timer-Driven Process Thread-4] o.a.nifi.processors.standard.QueryRecord QueryRecord[id=ac799474-0164-1000-ffff-ffffc83bf6e1] Unable to query StandardFlowFileRecord[uuid=78d37332-b122-4433-b16d-099757d8d839,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1532435241579-3, container=default, section=3], offset=0, length=108732158],offset=0,name=6117269883610207,size=108732158] due to java.lang.NullPointerException: {}
java.lang.NullPointerException: null
at Baz$5$1.current(Unknown Source)
at org.apache.calcite.linq4j.Linq4j$EnumeratorIterator.next(Linq4j.java:672)
at org.apache.calcite.avatica.util.IteratorCursor.next(IteratorCursor.java:46)
at org.apache.calcite.avatica.AvaticaResultSet.next(AvaticaResultSet.java:227)
at org.apache.nifi.serialization.record.ResultSetRecordSet.<init>(ResultSetRecordSet.java:51)
at org.apache.nifi.processors.standard.QueryRecord$1.process(QueryRecord.java:313)
at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2571)
at org.apache.nifi.processors.standard.QueryRecord.onTrigger(QueryRecord.java:306)
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1124)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
... View more
Labels:
- Labels:
-
Apache NiFi
07-12-2018
02:41 PM
Thanks for your answer. Your mention of using quotes in the ticket gave me the idea of stating the table name as "time" in the processor. With that it seems to work now. I don't know if this leads to other problems though. Edit: It seems like the where clause doesn't get insert in the statements. I don't know if it needs that though? If I try other kind of columns like numbers it puts a WHERE <column> <= <max_value> in the generated statement.
... View more
07-12-2018
11:08 AM
Hey there, I want to configure a data flow where I load new data as they get saved in a postgres database. For that I want to use the timestamp column in the GenerateTableFetch processor as maximum value column. Sadly the processor is not able to generate the right sql statements. Unable to execute SQL select query SELECT COUNT(*), MAX(time) time FROM log_table due to ERROR: syntax error at or near "time" It seems to have a problem with the alias, as would need the 'as' statement in postgres, but it seems to use no alias statement at all and fails because of this. Is there a way to fix that? Any help would be appreciated. Best regards, Markus
... View more
Labels:
- Labels:
-
Apache NiFi
07-06-2018
08:26 AM
NiFi needs to be configured for HTTPS access for the SSO redirecting to work.
... View more
07-05-2018
12:06 PM
Hey there, I'm currently trying to read files from the HDFS in the HDP cluster where NiFi is running (with HDF management pack). Is there a way that HDFS processors automatically get the configuration for core-site, hdfs-site and kerberos, without having to configure them every time I'm using the HDFS processors? Best regards, Markus
... View more
06-26-2018
06:11 AM
Hey there, currently trying to configure KnoxSSO authentication for NiFi. Sadly NiFi doesn't redirect to the KnoxSSO login site. The SSO part should work, because I'm already using it for the Ambari login. # Apache Knox SSO Properties #
nifi.security.user.knox.url=https://knoxgateway.local:8443/gateway/knoxsso/api/v1/websso
nifi.security.user.knox.publicKey=/certs/nifi/knox.pem
nifi.security.user.knox.cookieName=hadoop-jwt
nifi.security.user.knox.
Above is the relevant properties I configured. I didn't find anything else to do in the installation guide. Sadly there aren't any errors, so I really don't know where to go from here. Is there any configuration I may missed which is required for the redirect? Best regards, Markus
... View more
Labels:
05-16-2018
06:15 AM
Hey there, I'm trying to kerberize my cluster. I installed Kerberos 5 server following this guide. Everything there seemed to work. After that I tried to kerberize my cluster following the official documentation, but it fails after testing the Kerberos clients with the following error: 500 status code received on POST method for API: /api/v1/clusters/BIKW/requests
Error message: An internal system exception occurred: Failed to execute the command: Broken pipe
Sadly I couldn't find another post where someone had a similar problem. I attached the log with the complete error stack. ambari-server.zip I would appreciate any help. Best regards, Markus
... View more
Labels:
01-26-2018
09:06 AM
livy-stderr.txt Hey there, I'm trying to use Spark2 with Livy in Apache Zeppelin. But sadly I can get it to work, because the Livy session always shuts down with the error that it can't initialize the SparkContext. I can't seem to find the problem. The YARN resource manager doesn't even gets a request to start an application (as far as I can see in the logs), so I don't think the problem lies there. Also all other applications work just fine with YARN, including Spark submit and shell requests. Here is the livy.conf: livy.environment production
livy.impersonation.enabled true
livy.repl.enableHiveContext true
livy.rsc.rpc.server.address 192.168.1.22
livy.server.csrf_protection.enabled true
livy.server.port 8999
livy.server.recovery.mode recovery
livy.server.recovery.state-store filesystem
livy.server.recovery.state-store.url /livy2-recovery
livy.server.session.timeout 3600000
livy.spark.master yarn
livy.superusers zeppelin, livy I included the stderr log for the failed attempt. I would appreciate any help with this problem. Best regards, Markus
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache Zeppelin