@Arash Did you inspect the flowfile (assure its the expected format, etc) and inspect the flowfile attributes (may be more detail into the conflict).   Additionally, you can set the processor log level to DEBUG and/or monitor the nifi-app.log for more details.      If this worked before, and now doesnt,  i would expect something to have changed in the flowfile. ... View more

@Rohit1997jio   I do not think this is possible.   You would need a method outside of the consume/produce that handles logic for which consume topic maps to which produce topic.   Then you could use a dynamic topic name in the producer. However, you would still be limited in fact that ConsumeKafka doesnt take upstream connections.     In the example above,  if customerTopicX is attribute based, you can just use the same attribute logic in topic Name for  a single publishKafka versus three seen above.  That would atleast clean up your flow. ... View more

@MWM @cotopaul   If you get the record reader/writer using the schema(s) you want,  you do not have to do any magic to convert values, it should just work.     Only use, inferSchema long enough to get the structure when you have none.  Then copy/paste it and use it as @cotopaul has described in place of InferSchema.  You can also use Schema Registry.  Make the edits you need to satisfy reader (upstream), writer (downstream) as they are sometimes needing minor adjustments like in this case. ... View more

@manishg You should only copy individual nars that you know you need, not ALL 1.10 nars.   You error suggest a conflict with 1 or more.    That being said, be super careful with the expectation that things from 1.10 will work in 1.22.  Each of them would to be tested individually for compatibility in 1.22.x. ... View more

@JohnnyRocks ReplaceText more than once is something you want to avoid entirely.   You need to look at how to solve the schema concerns within the record based processors.  It should be possible to avoid ReplaceText all together.   If your upstream data is that different (3 different formats) within the same pipeline, consider how to address that upstream or in separate nifi flows.    Alternatively multiple pipelines can be built with separate top branch that pipes into the same record based processor.     This would be something like 3 single routes through a ReplaceText then all going to ConvertRecord.  However i would still try to optimize without ReplaceText in the manner described here. ... View more

@tqiu No, there is no more HDP.  That product is end of life.  Please check out how to upgrade HDP to CDP.     https://docs.cloudera.com/upgrade-companion/cdp_upgrade.html         ... View more

Let's take this a different direction... open up a code box in your reply.  Choose Preformatted:   Insert Lines 0 - 11 here Remove anything sensitive of course.  ... View more

@bhadraka It does not appear like this can be achieved with our CSVReader.   See this JIRA looking for a feature to set the skip rows: https://issues.apache.org/jira/browse/NIFI-8932   If your data's "10 rows" is always known and the same you could use a ReplaceText to get only 11+ rows.   You would match that text, and not replace it, just take the rest.        If the first 10 rows are just ignored and of the same structure as all rows, ie not some prepending lines with headers, etc; you could also use a CSV Reader and program your flow to simply ignore the first 10 flow files.     ... View more