Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error in Oozie Sqoop Import - NoSuchMethodError TProtocol.getScheme() - Ooze 4.2.0 Sqoop 1.4.6 HDP 2.3.2

Error in Oozie Sqoop Import - NoSuchMethodError TProtocol.getScheme() - Ooze 4.2.0 Sqoop 1.4.6 HDP 2.3.2

Explorer

I'm invoking Sqoop import using Oozie. Some of the sqoop imports get finished successfully. Some get failed due to the following error.

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception, org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class;
java.lang.NoSuchMethodError: org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class;

I found out that the issue is because of the hbase libthrift version jar. But I need to know how to overcome this issue. How to tell sqoop to look for the correct libthrift version jar or to tell sqoop not to look in the Hbase lib directory.


3 REPLIES 3
Highlighted

Re: Error in Oozie Sqoop Import - NoSuchMethodError TProtocol.getScheme() - Ooze 4.2.0 Sqoop 1.4.6 HDP 2.3.2

@Arun Sundar Selvan

Share the list of libraries under Oozie share lib. To address the issue, you could remove hbase libthrift jar from the Oozie share lib and try.

Highlighted

Re: Error in Oozie Sqoop Import - NoSuchMethodError TProtocol.getScheme() - Ooze 4.2.0 Sqoop 1.4.6 HDP 2.3.2

Explorer

@Sindhu Only libthrift0.9.2.jar is available in Oozie Shared lib of hive,hive2,pig.

Highlighted

Re: Error in Oozie Sqoop Import - NoSuchMethodError TProtocol.getScheme() - Ooze 4.2.0 Sqoop 1.4.6 HDP 2.3.2

Contributor
@Sindhu

The job copies libthrift-0.9.2 jar and sqoop share lib doesn't have libthrift jar under hbase.

There are no other versions of libthrift being copied to the container directory.

Don't have an account?
Coming from Hortonworks? Activate your account here