Created 05-12-2017 02:36 PM
I'm invoking Sqoop import using Oozie. Some of the sqoop imports get finished successfully. Some get failed due to the following error.
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception, org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class; java.lang.NoSuchMethodError: org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class; I found out that the issue is because of the hbase libthrift version jar. But I need to know how to overcome this issue. How to tell sqoop to look for the correct libthrift version jar or to tell sqoop not to look in the Hbase lib directory.
Created 05-17-2017 08:19 AM
Share the list of libraries under Oozie share lib. To address the issue, you could remove hbase libthrift jar from the Oozie share lib and try.
Created 05-17-2017 02:51 PM
@Sindhu Only libthrift0.9.2.jar is available in Oozie Shared lib of hive,hive2,pig.
Created 05-18-2017 01:04 PM
The job copies libthrift-0.9.2 jar and sqoop share lib doesn't have libthrift jar under hbase.
There are no other versions of libthrift being copied to the container directory.