About aervits

aervits · ‎02-11-2016

You have to decommission and then delete that node and stop the agent. it may require restart of services. @Ram D

aervits · ‎02-11-2016

@Darpan Patel go to the job history, drill down to the logs of the task attempt and you should see the result.

aervits · ‎02-11-2016

Ambari 2.2 does not support JDK 1.6, upgrade to latest 1.7 or 1.8 @Phoncy Joseph read the docs http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_upgrading_Ambari/content/_preparing_to_upgrade_ambari.html

aervits · ‎02-11-2016

if it's an MR program, you can write out fewer files, consider using smaller number of reducers and use compression. Specifics of which can be a separate question on this website. @ARUNKUMAR RAMASAMY

aervits · ‎02-11-2016

what is your JDK version with Ambari 2.2? I'm wondering if you're hitting this https://issues.apache.org/jira/browse/AMBARI-14778 @Phoncy Joseph

aervits · ‎02-11-2016

@ARUNKUMAR RAMASAMY copy command is slower than for example move or distcp. Zipping the 300 files into 1 larger file would make things better for you as Hadoop likes large individual files over many files/directories. You can use merge command, maybe compress and take a look at Hadoop Archive format, then try copying again.

aervits · ‎02-11-2016

@Roberto Sancho you can also use Active Directory as opposed to Kerberos. http://hortonworks.com/blog/enabling-kerberos-hdp-active-directory-integration/

aervits · ‎02-11-2016

@Roberto Sancho 1. 128mb block 2.larger files the better 3. Minimum factor of 3 It's also good to merge these files either using HAR or rewrite into bigger files

aervits · ‎02-11-2016

+1 cost savings are great but not with backups

aervits · ‎02-11-2016

@Cassandra I think you're asking how to specify IP ranges in firewall rules? If so, here's a way http://www.cyberciti.biz/tips/linux-iptables-how-to-specify-a-range-of-ip-addresses-or-ports.html

Online	Offline
Last Visited	‎08-15-2019 06:35 AM

Member Since	‎10-01-2015 11:46 AM
Last Visited	‎08-15-2019 06:35 AM
Posts	3,933
Kudos received	1074

Cloudera Community

Re: Where can I get latest resource_management.c...

Re: How to Kerberize Flume?

Re: Load Hive Table form Pig Output File.

Re: HDP 2.6 Cluster Issues with Hive Metastore

Re: which HDP release will storm 1.1.0 be packaged...

Re: How to make ambari forget about decommissioned...

Re: Not able to run the sample PI program in YARN ...

Re: Proxy error while starting services in Ambari ...

Re: Taking long time to copy files from hdfs

Re: Proxy error while starting services in Ambari ...

Re: Taking long time to copy files from hdfs

Re: Security HDP

Re: Best practices between size block , size file ...

Re: How many NameNodes needed on Backup Cluster

Re: Is there a list of IP address ranges for firew...