Member since
07-20-2016
37
Posts
3
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4382 | 12-21-2016 08:05 PM | |
6417 | 12-14-2016 06:38 PM | |
1560 | 10-10-2016 10:02 PM | |
2491 | 08-05-2016 09:04 AM |
05-21-2017
11:11 PM
1 Kudo
Either one will work, but on a long-running cluster where you rarely restart Yarn, set it to the FQDN of rm1, and also set rm1 to be the active RM. That's because the discovery of active RM is done in sequence rm1 --> rm2.
... View more
04-06-2017
10:15 PM
1 Kudo
If you want to minimize your down time you can try to stop nodes one by one, upgrade RAM and restart all components on the node after restart. You must do masters one by one, but in case of workers you can do in sets of 2, or if you have rack-awarness in sets of 3-4 or even rack by rack. You need HA configuration of major services like HDFS, Yarn, HBase, Hive for this to work. You also need replication of Kafka topics of at least 2, and do Kafka nodes one by one, if you have Kafka.
... View more
04-03-2017
08:16 PM
Hey @Vipin Rathor, I corrected the question. Yeah, even I think zeppelin don't have that feature yet. Thanks for the response .
... View more
04-19-2017
02:52 PM
@yvora Sorry for late reply, i am again getting the same issue. It is just sc.version
... View more
03-20-2017
06:00 PM
2 Kudos
@dvt isoft Not necessarily. That would be only if your blocks will be 100% filled with data. Let's say you have a 1024 MB file and the block size is 128 MB. That would be exactly 8 blocks at 100%. Let's say you have 968 MB file and the block size is128 MB. That is still 8 blocks but with lower usage. A block once used by a file cannot be reused for a different file. That's why loading small files could be a waste. Just imagine 100 files of each 100 KB will be using 100 blocks for 128 MB, 10x more than the examples I provided above. You need to understand your files, block % usage etc. The command you execute shows the blocks empty x size/block ... I know that is confusing 🙂 +++ If this is helpful please vote and accept as the best answer.
... View more
02-16-2017
04:58 PM
1 Kudo
@Bhavin Tandel I had a similar issue recently and while the Ambari YARN Queue Manager View doesn't offer a configurable URL, a workaround I found was to add the cluster as a Remote Cluster (using the alias URL when defining the Ambari Cluster URL) and then point the View to the remote cluster. This seemed to work just fine.
... View more
12-14-2016
06:57 PM
1 Kudo
@Bhavin Tandel good to know 🙂 Thanks
... View more
08-05-2016
04:32 PM
Thanks @Alexandru Anghel This was very informative
... View more