Reply
Highlighted
Explorer
Posts: 18
Registered: ‎05-09-2017

Pig job failure with ERROR 2998 : Unhandled internal error

Hi, 

 

I am seeing this error when running pig jobs. Which parameter has to be tuned. 

 

The map and redude cluster wide memory is 4G for map and 4G for reduce. 

We are not settnig any heap while running job. 

 

2017-06-29 20:05:10,664 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS

2017-06-29 20:05:10,718 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS

2017-06-29 20:05:12,220 [main] INFO  org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: REPLICATED_JOIN,HASH_JOIN,DISTINCT,FILTER

 

2017-06-29 20:42:02,042 [Service Thread] INFO  org.apache.pig.impl.util.SpillableMemoryManager - first memory handler call- Usage threshold init = 698875904(682496K) used = 597759256(583749K) committed = 698875904(682496K) max = 698875904(682496K)

2017-06-29 20:42:02,934 [Service Thread] INFO  org.apache.pig.impl.util.SpillableMemoryManager - first memory handler call - Collection threshold init = 698875904(682496K) used = 457643760(446917K) committed = 698875904(682496K) max = 698875904(682496K)

2017-06-29 20:52:26,919 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. Java heap space Details at logfile: xxxxxx

Announcements
New solutions