Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Scalding job failure in CDH5.4

Scalding job failure in CDH5.4



Hi All,


We have the scalding job (v 2.9.2), which was running properly in the CDH 4 cluster. Now, after upgrading to CDH 5.4 we're experiencing the job failures

Is someone familiar with this problem? We suspect that it's related to the jars collisions but moving to the shaded jar didn't resolve the problem


Any help will be highly appreciated

Thank you,



07:23:54,497 FATAL [IPC Server handler 3 on 55444] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1436182708795_0534_m_000007_1 - exited : Split class not found
	at org.apache.hadoop.mapred.MapTask.getSplitDetails(
	at org.apache.hadoop.mapred.MapTask.runOldMapper(
	at org.apache.hadoop.mapred.YarnChild$
	at Method)
	at org.apache.hadoop.mapred.YarnChild.main(
Caused by: java.lang.ClassNotFoundException: Class not found
	at org.apache.hadoop.conf.Configuration.getClassByName(
	at org.apache.hadoop.mapred.MapTask.getSplitDetails(



Re: Scalding job failure in CDH5.4

Master Guru
This seems like a job packaging or distributed-cache configuration issue. The scalding/cascading folks may be able to better comment on this, but perhaps the resolutions discussed on may help you?