Is there a way to get Hive or Pig to output in a single file instead of the parts files? The only way I know to get this to work is set the mappers to 1 for map only jobs and the reducers to 1 for the other jobs. Any suggestions?
Hive offers some post-query merge options. For example "hive.merge.mapredfiles" here https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration