Member since
03-30-2015
7
Posts
5
Kudos Received
0
Solutions
05-17-2017
02:51 PM
@Sindhu Only libthrift0.9.2.jar is available in Oozie Shared lib of hive,hive2,pig.
... View more
05-12-2017
03:53 PM
copy the following jars into hive folder. And then into Oozie hive sharelib folder. /usr/hdp/2.3.2.0-2950/hive/lib/guava-14.0.1.jar,/usr/hdp/2.3.2.0-2950/hive/lib/zookeeper-3.4.6.2.3.2.0-2950.jar,/usr/hdp/2.3.2.0-2950/hive/lib/hive-hbase-handler.jar ,/usr/hdp/2.3.2.0-2950/hbase/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.3.2.0-2950/hbase/lib/hbase-client.jar,/usr/hdp/2.3.2.0-2950/hbase/lib/hbase-common.jar,/usr/hdp/2.3.2.0-2950/hbase/lib/hbase-server.jar,/usr/hdp/2.3.2.0-2950/hbase/lib/hbase-protocol.jar,/usr/hdp/2.3.2.0-2950/hbase/lib/hbase-hadoop-compat.jar,/usr/hdp/2.3.2.0-2950/hbase/lib/hbase-hadoop2-compat.jar,/usr/hdp/2.3.2.0-2950/hbase/lib/netty-3.2.4.Final.jar Oozie Update shaerlib.
... View more
05-12-2017
02:36 PM
I'm invoking Sqoop import using Oozie. Some of the sqoop imports get finished successfully. Some get failed due to the following error. Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception, org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class;
java.lang.NoSuchMethodError: org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class;
I found out that the issue is because of the hbase libthrift version jar. But I need to know how to overcome this issue. How to tell sqoop to look for the correct libthrift version jar or to tell sqoop not to look in the Hbase lib directory.
... View more
Labels:
03-22-2017
02:09 PM
I have an example. Kindly clarify me whether we can use Sqoop in Yarn DS on this scenario. Lets say I need to take the delta from 30 Oracle tables every 1 hr and also there is no real time connector to pull that. Now if I use oozie Sqoop with sequential approach, I don't think the all the 30 oozie jobs will be completed within the 1 hr time frame. I can hard-code 30 tables in oozie fork-join and trigger it, but i want to trigger the import process dynamically. In this scenario I can use Yarn Distributed shell just to trigger the shell script , which dynamically imports the data.
... View more
03-25-2016
04:43 AM
2 Kudos
Is it mandatory to start atlas in sandbox to work in Hive? Hive has a metastore. Is it possible to have atlas dependency as pluggable for hive?
... View more
Labels:
03-14-2016
07:17 PM
Can you please share the stdout log from the Job-tracker.
... View more
03-09-2016
04:41 PM
3 Kudos
Hi, I also faced the same issue. But when I copied *-site.xml from /etc/hadoop/conf to hadoop spark lib directory (in job.properties), the oozie spark job ran successfully. My RM is IP:8032 in Ambari and in yarn-site.xml Thanks
... View more