Support Questions

Find answers, ask questions, and share your expertise

Error in Oozie Sqoop Import - NoSuchMethodError TProtocol.getScheme() - Ooze 4.2.0 Sqoop 1.4.6 HDP 2.3.2

Explorer

I'm invoking Sqoop import using Oozie. Some of the sqoop imports get finished successfully. Some get failed due to the following error.

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception, org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class;
java.lang.NoSuchMethodError: org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class;

I found out that the issue is because of the hbase libthrift version jar. But I need to know how to overcome this issue. How to tell sqoop to look for the correct libthrift version jar or to tell sqoop not to look in the Hbase lib directory.


3 REPLIES 3

@Arun Sundar Selvan

Share the list of libraries under Oozie share lib. To address the issue, you could remove hbase libthrift jar from the Oozie share lib and try.

Explorer

@Sindhu Only libthrift0.9.2.jar is available in Oozie Shared lib of hive,hive2,pig.

Contributor
@Sindhu

The job copies libthrift-0.9.2 jar and sqoop share lib doesn't have libthrift jar under hbase.

There are no other versions of libthrift being copied to the container directory.