Created 05-23-2023 05:35 AM
Hi team,
We were in process of migrating the flow from HDF to CDP. We migrated few and while testing the flow they are working fine on new home we encountered an issue. We were working on flow in which we encountered and issue with processor 'InferAvroSchema 1.18.0.2.2.6.0-260' where as procssor 'InferAvroSchema 1.9.0.3.4.0.22-1' which was working fine with the data. While working with new processor we encountered an issue which is listed below:
ERROR b11042ff-c573-1d90-0000-0000338c6dea rit-dev-nifi-nifi0.regn-cld.fxd6-2a7z.cloudera.site:8443InferAvroSchema[id=b11042ff-c573-1d90-0000-0000338c6dea] Processing halted: yielding [1 sec]: java.lang.NoSuchMethodError: org.apache.avro.Schema$Field.<init>(Ljava/lang/String;Lorg/apache/avro/Schema;Ljava/lang/String;Lorg/codehaus/jackson/JsonNode;)V
Nifi Verson:
Created 05-23-2023 08:11 AM
@NaBeeL_NaQeeBi Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our CDP experts @aakulov @PabitraDas who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Created 05-23-2023 09:15 AM
As far as I know, InferAvroSchema is not a supported processor. However there are record-based processors and an AvroReader controller service you can use with those processors. AvroReader has a (default) option to Infer Schema. This should achieve the same effect, and record-based processors are often more performant.
Created 05-29-2023 11:42 AM
@NaBeeL_NaQeeBi Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
Regards,
Diana Torres,