Member since
09-29-2015
871
Posts
721
Kudos Received
255
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2618 | 12-03-2018 02:26 PM | |
1723 | 10-16-2018 01:37 PM | |
3106 | 10-03-2018 06:34 PM | |
1853 | 09-05-2018 07:44 PM | |
1464 | 09-05-2018 07:31 PM |
04-04-2017
02:33 PM
Ok, the best test would be to see if you could setup the HDFS client on one of the HDF servers and then retrieve it using the command line there. If that doesn't work it would narrow down the problem to something outside of NiFi, if that works then we need to think more why NiFi can't retrieve it 🙂
... View more
04-04-2017
02:29 PM
Is this the first time you start NiFi, or you had been running for a while?
... View more
04-04-2017
02:19 PM
Taking HDF out of the picture for a second, are you able retrieve the file (/user/putarapasa/OCA_Nestac_XRef_Old.xlsx) from HDFS using the command line?
... View more
03-30-2017
01:30 PM
2 Kudos
Yes in nifi.properties see the following properties: # Comma-separated list of fields. Fields that are not indexed will not be searchable. Valid fields are: # EventType, FlowFileUUID, Filename, TransitURI, ProcessorID, AlternateIdentifierURI, Relationship, Details
nifi.provenance.repository.indexed.fields=EventType, FlowFileUUID, Filename, ProcessorID, Relationship # FlowFile Attributes that should be indexed and made searchable. Some examples to consider are filename, uuid, mime.type
nifi.provenance.repository.indexed.attributes=
... View more
03-27-2017
06:10 PM
The first error is expected behavior, only one process can bind to an operating system port as a listener, so the first ListenTCP that you start with that port is the only one that can bind to it. This would be similar to starting two NiFi instances on the same machine and leaving their web ports both set as 8080, one will come up and one will fail. The second part is hard to tell with out more info. Need to see which processor, if custom it would help to see the code, and also need to see the stacktrace from the logs.
... View more
03-23-2017
02:33 PM
1 Kudo
You should be able to delete all the files underneath "provenance_repository/journals/" and I think it will come back up correctly and you will only lose a couple of minutes or less of provenance data. Of course if that doesn't work you can completely delete provenance_repository all together and restart with a clean provenance repo.
... View more
03-23-2017
02:26 PM
2 Kudos
This looks like this issue: https://issues.apache.org/jira/browse/NIFI-3186 Can you upgrade to 1.1.1?
... View more
03-23-2017
02:13 PM
3 Kudos
It is really the client (the sending application/system) that should be closing the connection when it is done writing a certain amount of data, the server (ListenTCP) can't really know when the client is "done". If the client was closing connections, then you would only exceed the Max TCP Connections if the client was making concurrent connections that exceed this number at one point in time.
... View more
03-22-2017
01:14 PM
1 Kudo
You can define a variable in bootstrap.conf like java.arg.15=-Demails.to=address1,address2,address3 and then your PutEmail processors reference ${emails.to} for the to address. Alternatively, you can also use the variable registry feature. In nifi.properties: # external properties files for variable registry
# supports a comma delimited list of file locations
nifi.variable.registry.properties= You could specify a properties file here that had a property: emails.to=address1,address2,address3 And then reference it the same as ${emails.to}. In either case a restart of NiFi is required to pick up changes.
... View more
03-21-2017
08:24 PM
Syslog messages start with a priority which is enclosed in < > so it should have started with something like "<10> Mar 21...." https://tools.ietf.org/html/rfc5424#section-6.2.1 https://www.ietf.org/rfc/rfc3164 (section 4.1.1) Regarding using ExtractText... yes if you got the date out of the content and into an attribute then you should be able to use UpdateAttribute with expression language functions to parse the date into the directory and filename you want.
... View more