Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2579 | 11-01-2016 05:43 PM | |
| 8558 | 11-01-2016 05:36 PM | |
| 4881 | 07-01-2016 03:20 PM | |
| 8213 | 05-25-2016 11:36 AM | |
| 4354 | 05-24-2016 05:27 PM |
12-04-2015
08:28 PM
Accepting this as best answer. Thanks @Ali Bajwa
... View more
12-04-2015
07:35 PM
@Ameet Paranjape @Mark Herring Shall we close this question as not reproducible?
... View more
12-04-2015
04:01 PM
@kkane that's by design. Please see this http://hortonworks.com/blog/introducing-tez-sessions/
... View more
12-04-2015
02:21 PM
@bsaini This is very nice! Wikify 🙂
... View more
12-04-2015
03:53 AM
@Ali Bajwa [hdfs@phdns01 ~]$ hadoop jar /usr/hdp/2.3.4.0-3276/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar nnbench -operation create_write -maps 1 -reduces 1 -blockSize 1 -bytesToWrite 0 -numberOfFiles 1000 -replicationFactorPerFile 3 -readFileAfterOpen true -baseDir /benchmarks/NNBench WARNING: Use "yarn jar" to launch YARN applications. NameNode Benchmark 0.4 15/12/03 19:53:11 INFO hdfs.NNBench: Test Inputs: 15/12/03 19:53:11 INFO hdfs.NNBench: Test Operation: create_write 15/12/03 19:53:11 INFO hdfs.NNBench: Start time: 2015-12-03 19:55:11,636
... View more
12-04-2015
03:36 AM
@Ali Bajwa I see its part of the code link search [root@phdns01 hadoop]# yarn jar /usr/hdp/2.3.4.0-3276/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar nnbench –operation create_write NameNode Benchmark 0.4 15/12/03 19:50:23 INFO hdfs.NNBench: Test Inputs: 15/12/03 19:50:23 INFO hdfs.NNBench: Test Operation: none 15/12/03 19:50:23 INFO hdfs.NNBench: Start time: 2015-12-03 19:52:23,879 15/12/03 19:50:23 INFO hdfs.NNBench: Number of maps: 1 15/12/03 19:50:23 INFO hdfs.NNBench: Number of reduces: 1 15/12/03 19:50:23 INFO hdfs.NNBench: Block Size: 1 15/12/03 19:50:23 INFO hdfs.NNBench: Bytes to write: 0 15/12/03 19:50:23 INFO hdfs.NNBench: Bytes per checksum: 1 15/12/03 19:50:23 INFO hdfs.NNBench: Number of files: 1 15/12/03 19:50:23 INFO hdfs.NNBench: Replication factor: 1 15/12/03 19:50:23 INFO hdfs.NNBench: Base dir: /benchmarks/NNBench 15/12/03 19:50:23 INFO hdfs.NNBench: Read file after open: false Error: Unknown operation: none Usage: nnbench <options> Options: -operation <Available operations are create_write open_read rename delete. This option is mandatory> * NOTE: The open_read, rename and delete operations assume that the files they operate on, are already available. The create_write operation must be run before running the other operations. -maps <number of maps. default is 1. This is not mandatory> -reduces <number of reduces. default is 1. This is not mandatory> -startTime <time to start, given in seconds from the epoch. Make sure this is far enough into the future, so all maps (operations) will start at the same time. default is launch time + 2 mins. This is not mandatory> -blockSize <Block size in bytes. default is 1. This is not mandatory> -bytesToWrite <Bytes to write. default is 0. This is not mandatory> -bytesPerChecksum <Bytes per checksum for the files. default is 1. This is not mandatory> -numberOfFiles <number of files to create. default is 1. This is not mandatory> -replicationFactorPerFile <Replication factor for the files. default is 1. This is not mandatory> -baseDir <base DFS path. default is /becnhmarks/NNBench. This is not mandatory> -readFileAfterOpen <true or false. if true, it reads the file and reports the average time to read. This is valid with the open_read operation. default is false. This is not mandatory> -help: Display the help statement [root@phdns01 hadoop]#
... View more
12-04-2015
01:23 AM
@schauhan I could not find the answer. Really good question. @gopal @yzhang
... View more