Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

"ERROR 2017: Internal error creating job configuration" error in Apache Pig

"ERROR 2017: Internal error creating job configuration" error in Apache Pig

Explorer

Hi,

I'm getting the below error :

java.lang.RuntimeException: org.apache.pig.backend.hadoop.executionengine.JobCreationException: ERROR 2017: Internal error creating job configuration.

while using the ILLUSTRATE and DUMP commands in Apache Pig.

Is there any issue with the Sandbox? How can I resolve it? Could someone please help?

Thanks,

3 REPLIES 3

Re: "ERROR 2017: Internal error creating job configuration" error in Apache Pig

Can you tell us more about what you are doing? Are you doing a tutorial? If so, which one and in what step are you running into issues? What version of the sandbox are you using?

Re: "ERROR 2017: Internal error creating job configuration" error in Apache Pig

Explorer

Yes, trying to follow a tutorial on YouTube. I'm using the sandbox VM version 2.6.4.

I tried the belong commands in the pig shell :

grunt> orderitemsgroupall = GROUP order_items ALL ;

grunt> orderitemscount = FOREACH orderitemsgroupall GENERATE COUNT_STAR(order_items) AS cnt;

grunt> ordersjoingrouped = GROUP ordersjoin ALL;

grunt> ordersjoincount = FOREACH ordersjoingrouped GENERATE COUNT_STAR(ordersjoin) AS cnt;

I’m getting the error “ERROR 2017: Internal error creating job configuration.” when I run the below commands:

grunt> ILLUSTRATE ordersjoin;

grunt> DUMP orderitemscount ;

grunt> DUMP ordersjoincount;

I'm getting the below error :

Log :

Pig Stack Trace
---------------
ERROR 1003: Unable to find an operator for alias orderjoinlimit

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1003: Unable to find a
n operator for alias orderjoinlimit
_ at org.apache.pig.PigServer$Graph.buildPlan(PigServer.java:1628)_
_ at org.apache.pig.PigServer.storeEx(PigServer.java:1113)_
_ at org.apache.pig.PigServer.store(PigServer.java:1081)_
_ at org.apache.pig.PigServer.openIterator(PigServer.java:994)_
_ at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:7_
45)
_ at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScript_
Parser.java:376)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:229)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:204)
_ at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)_
_ at org.apache.pig.Main.run(Main.java:564)_
_ at org.apache.pig.Main.main(Main.java:175)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl._
java:62)
_ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces_
sorImpl.java:43)
_ at java.lang.reflect.Method.invoke(Method.java:498)_
_ at org.apache.hadoop.util.RunJar.run(RunJar.java:233)_
_ at org.apache.hadoop.util.RunJar.main(RunJar.java:148)_
================================================================================
Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.

java.io.IOException: Exception
_ at org.apache.pig.PigServer.getExamples(PigServer.java:1395)_
_ at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser._
java:803)
_ at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigS_
criptParser.java:818)
_ at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScript_
Parser.java:385)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:229)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:204)
_ at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)_
_ at org.apache.pig.Main.run(Main.java:564)_
_ at org.apache.pig.Main.main(Main.java:175)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl._
java:62)

Re: "ERROR 2017: Internal error creating job configuration" error in Apache Pig

Explorer

I was able to execute the same commands in Cloudera without any issues. I think the issue is with Sandbox.

There is something wrong with the command in Sandbox:

pig -useHCatalog

Don't have an account?
Coming from Hortonworks? Activate your account here