Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

Highlighted

While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

A = load 'emp1' Using org.apache.hcatalog.pig.HCatLoader(); 2016-03-04 22:09:43,693 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat Details at logfile: /usr/lib/hive-0.13.1-bin/hcatalog/share/hcatalog/pig_1457109532357.log

6 REPLIES 6

Re: While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

Guru
@Gurjinder Singh

This is your third question in the forum regarding the same issue, and you have not chosen answers to your previous posts. You will get better results from the forum if you resolve your previous posts before opening new ones.

Can you share the contents of the log file mentioned in the error message above? There is probably some useful information in there:

/usr/lib/hive-0.13.1-bin/hcatalog/share/hcatalog/pig_1457109532357.log
Highlighted

Re: While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

I have already applied the solutions yu told but same issues now after logging again in morning this new issue appeared I am sending you the content of file:

Pig Stack Trace --------------- ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/mapreduce/HCatInputFormat at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.pig.impl.PigContext.resolveClassName(PigContext.java:635) at org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1257) at org.apache.pig.parser.LogicalPlanBuilder.buildFuncSpec(LogicalPlanBuilder.java:1245) at org.apache.pig.parser.LogicalPlanGenerator.func_clause(LogicalPlanGenerator.java:5069) at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3426) at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1536) at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1013) at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:553) at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421) at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:188) at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1648) at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1621) at org.apache.pig.PigServer.registerQuery(PigServer.java:575) at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1093) at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173) at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69) at org.apache.pig.Main.run(Main.java:541) at org.apache.pig.Main.main(Main.java:156) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.ClassNotFoundException: org.apache.hive.hcatalog.mapreduce.HCatInputFormat at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 27 more

Highlighted

Re: While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

Guru

That is a classpath issue. You probably don't have your HADOOP_CLASSPATH set correctly - the HCatalog JARs are missing. Are you running HDP? What is the value of your HADOOP_CLASSPATH?

Highlighted

Re: While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

I already have this table in default db

Highlighted

Re: While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

Mentor

Please use HDP to run your examples, Apache Hadoop release requires a lot more manual configuration to make Hive, HCatalog and Pig work together.

Highlighted

Re: While using hive tables in pig getting :ERROR 2998: Unhandled internal error. org/apache/hive/hcatalog/mapreduce/HCatInputFormat

M also facing similar issue as described above.

How can i modify Hadoop_classpath and also what need to be added. Please suggest @Rich Raposa

Don't have an account?
Coming from Hortonworks? Activate your account here