I am using ExecuteSQL to extract data from Oracle. While retrieving the records, data type of NUMBER is getting converted to BYTES. So to keep the Number to long/double I am using "ConvertRecord" processor. In "Convert Record" processor, I choose AvroReader using embedded schema and for AvroRecordSerWriter used external schema to change the bytes datatypes to long/int. But once the processor executes, I saw that the schema is getting lost as I am not able to convert to orc in order to create Hive table. Is this is any kind of bug? ... View more

While running the querydatabase processor in NiFi some records are getting lost. I am try to pull the data from Oracle DB and the maximum-column-value is a created Date of the date datatype. There is no timestamp attached to that(23-JUN-18) . While triggering the job every 5 mins to achieve near-real time ingestion some records are getting lost. I am not sure whether this is happening due to time stamp not present in the table OR whether this can be a synchronization issue like while querying the DB if new records got inserted. ... View more