Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi ConvertAvroToOrc Processor java.lang.NoClassDefFoundError: org/tukaani/xz/XZInputStream error

Nifi ConvertAvroToOrc Processor java.lang.NoClassDefFoundError: org/tukaani/xz/XZInputStream error

New Contributor

Hi,

I have created hdf 3.1 cluster in azure via cloudbreak 2.7.0 (I also tried nifi coming with hdf management pack on hdp cluster on azure same problem). I am getting the following error in ConvertAvroToORC processor. I have been using the same flow in another on-premise cluster without problem. What can be causing this?

	2018-06-29 16:53:50,449 WARN [Timer-Driven Process Thread-6] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding ConvertAvroToORC[id=4c5f4ab4-0164-1000-0000-0000698d849d] due to uncaught Exception: java.lang.NoClassDefFoundError: org/tukaani/xz/XZInputStream
	2018-06-29 16:53:50,449 WARN [Timer-Driven Process Thread-6] o.a.n.c.t.ContinuallyRunProcessorTask
	java.lang.NoClassDefFoundError: org/tukaani/xz/XZInputStream
	at org.apache.avro.file.XZCodec.decompress(XZCodec.java:74)
	at org.apache.avro.file.DataFileStream$DataBlock.decompressUsing(DataFileStream.java:352)
	at org.apache.avro.file.DataFileStream.hasNext(DataFileStream.java:199)
	at org.apache.nifi.processors.hive.ConvertAvroToORC.lambda$onTrigger$0(ConvertAvroToORC.java:234)
	at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2827)
	at org.apache.nifi.processors.hive.ConvertAvroToORC.onTrigger(ConvertAvroToORC.java:208)
	at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
	at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1122)
	at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
	at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
	at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	Caused by: java.lang.ClassNotFoundException: org.tukaani.xz.XZInputStream
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
3 REPLIES 3

Re: Nifi ConvertAvroToOrc Processor java.lang.NoClassDefFoundError: org/tukaani/xz/XZInputStream error

Can you share your configuration for ConvertAvroToORC? I'm wondering if there are compression settings in some *-site.xml file used to configure it, or maybe for the Compression Type property...

Re: Nifi ConvertAvroToOrc Processor java.lang.NoClassDefFoundError: org/tukaani/xz/XZInputStream error

New Contributor

I have tried all compression types. Same error. Current configuration can be seen in screenshot. What property in *-site.xml s can be causing this, any idea?

screen-shot-2018-06-30-at-212647.png

Re: Nifi ConvertAvroToOrc Processor java.lang.NoClassDefFoundError: org/tukaani/xz/XZInputStream error

New Contributor

I really cannot understand behavior of this forum. Most of the problems I experience can be easily reproduced and straightforward, but I usually don't get any help about these issues.

Don't have an account?
Coming from Hortonworks? Activate your account here