Hello, Wanted to find out what's the NiFi best practice for a use case I am working on; The incoming data has codes and the codes should be replaced with the corresponding code descriptions, from a manually maintained static (almost static, rarely changes) list of codes and their corresponding descriptions in a file. Is ReplaceTextWithMapping the right processor to implement this. Thanks. ... View more

Hi guys, We have Flume setup on the Hadoop cluster and it is working. I am trying to use the Flume data as source in NiFi, I set up the required properties in NiFi's ExecuteFlumeSource processor, but it gives "unable to load source type" error. Any thoughts on what's causing the error? Thank you. ... View more

Hello, I'm trying to create Hive insert statements for NiFi's PutHiveQL processor; I've a timestamp column in the Hive table and the incoming value for this column is in string format, like 20161011075959 (no milliseconds). I tried using toDate, Format, toNumber in various combinations to convert the string to DateTime format in the Hive insert statement, but the data in Hive table shows NULL value for this column regardless; can anyone tell me what's the correct way to convert string to datetime for Hive. None of the below seem to work: ${Abc.DateTimeOfMessage:toDate("yyyyMMddHHmmss")} ${Abc.DateTimeOfMessage:format("yyyy/MM/dd HH:mm:ss")} ${Abc.DateTimeOfMessage:toDate("yyyyMMddHHmmss"):toNumber()} Thanks in advance for your time. ... View more

Hi All, I'm trying to convert data in JSON to Avro using ConvertJSONToAvro; and for the Avro schema ConvertJSONToAvro processor requires, I'm using InferAvroSchema processor; but I'm getting an error at InferAvroSchema; it throws "org.apache.avro.schemaparseexception illegal character in: avro-schema" error. I looked at the flowfile contents and replaced all attributes names that have a .(dot) with _(underscore), but still no help. Rest of the flowfile data looks ok, so I'm not sure what's causing the exception. Any thoughts on how to resolve this would be greatly appreciated. Thanks. ... View more