Created 02-19-2016 07:06 AM
Hi,
Can anyone suggest me any possible way for "seeing output of a MR job as a single file even if reducer has created multiple part-r-0000* files?"
Created 02-19-2016 08:15 AM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 02-19-2016 07:15 AM
I got below answer:
hdfs dfs -getmerge <src> <localdst> [addnl]
-
Above command worked for me.
Created 02-19-2016 11:12 AM
@Rushikesh Deshmukh what command worked for you? Did @Predrag Minovic question help you? If so please accept his answer and not your own as we do not know what solved it for you. You do not earn points for accepting own answers and its not a good practice unless you find your own solution.
Created 02-19-2016 11:25 AM
@Artem Ervits, the above mentioned command worked in my case to see output as single file while reducer output had created multiple parts file, thus I have accepted that answer.
Created 02-19-2016 08:15 AM
Want to get a detailed solution you have to login/registered on the community
Register/Login