Reply
New Contributor
Posts: 2
Registered: ‎07-31-2013

Hive and Pig Output

Is there a way to get Hive or Pig to output in a single file instead of the parts files?  The only way I know to get this to work is set the mappers to 1 for map only jobs and the reducers to 1 for the other jobs.  Any suggestions?

Expert Contributor
Posts: 63
Registered: ‎08-06-2013
Cloudera Employee
Posts: 26
Registered: ‎08-06-2013

Re: Hive and Pig Output

Hive offers some post-query merge options. For example "hive.merge.mapredfiles" here https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration