Member since
01-18-2019
3
Posts
0
Kudos Received
0
Solutions
12-08-2018
05:02 PM
Recordwriter writes the output the reducer phase (output can be zero 1 or more key value pairs. ) to the output files output format determines how recordwrite writes these key value pairs in output files files output format subclass will create output files , even if they empty but some application prefer not to create empty files , lazy output format used in this scenario .
... View more
12-07-2018
01:15 PM
Navigate to your "/install/hadoop/datanode/bin" folder or path where you could execute your hadoop commands: To place the files in HDFS: Format: hadoop fs -put "Local system path"/filename.csv "HDFS destination path" eg)./hadoop fs -put /opt/csv/load.csv /user/load Here the /opt/csv/load.csv is source file path from my local linux system. /user/load means HDFS cluster destination path in "hdfs://hacluster/user/load" To get the files from HDFS to local system: Format : hadoop fs -get "/HDFSsourcefilepath" "/localpath" eg)hadoop fs -get /user/load/a.csv /opt/csv/ After executing the above command, a.csv from HDFS would be downloaded to /opt/csv folder in local linux system. This uploaded files could also be seen through HDFS NameNode web UI.
... View more