About aervits

aervits · ‎02-17-2016

@Dennis Fridlyand why don't upgrade to 2.2.9.0 first, the current 2.2.8 will be de-registered and try again then? Also consider trying Ambari 2.2.1.0 that was just released. I'm guessing but I think Ambari can only maintain 4 versions of HDP and you have all four, you might need to drop one before upgrading to 2.3.4. Wierder things have happened...

aervits · ‎02-17-2016

@Rushikesh Deshmukh which service are you referring to? Every service like hdfs, hbase, etc, require their own approaches to taming GC pauses.

aervits · ‎02-17-2016

I don't, look for it within the next 4-8 weeks. @cokorda putra susila

aervits · ‎02-17-2016

@Roberto Sancho here's a list of all deprecated mapred properties and new properties, https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/DeprecatedProperties.html the property you're looking for is called mapreduce.job.reduces

aervits · ‎02-17-2016

Wait for HDP 2.4 which will be released very soon and has full support for 1.6 Spark @cokorda putra susila

aervits · ‎02-17-2016

Spark 1.6 is not supported yet. I answered in the other thread to install Spark client @cokorda putra susila

aervits · ‎02-17-2016

@Roberto Sancho I would look at setting intermediate compression from map tasks and ouput compression from reduce tasks You can also look at using combiner class. mapreduce.map.output.compress mapreduce.map.output.compress.codec and output compression mapreduce.output.fileoutputformat.compress.codec mapreduce.output.fileoutputformat.compress.type mapreduce.output.fileoutputformat.compress

aervits · ‎02-17-2016

@Guilherme Braccialli yes but this is from official source!

aervits · ‎02-17-2016

@marko we don't officially support 7.2 maybe this is one of the reasons? Try to update your host. If you have access to 7.0 or 7.1 machine?

aervits · ‎02-17-2016

@cokorda putra susila make sure to install Spark client on the host you are running this from. Go to host components page and install Spark client.

Online	Offline
Last Visited	‎08-15-2019 06:35 AM

Member Since	‎10-01-2015 11:46 AM
Last Visited	‎08-15-2019 06:35 AM
Posts	3,933
Kudos received	1074

Cloudera Community

Re: Where can I get latest resource_management.c...

Re: How to Kerberize Flume?

Re: Load Hive Table form Pig Output File.

Re: HDP 2.6 Cluster Issues with Hive Metastore

Re: which HDP release will storm 1.1.0 be packaged...

Re: Registered version HDP-2.3.4.0 is not listed

Re: What is best approach to handling GC pause err...

Re: Upgrade spark 1.5 to 1.6 HDP 2.3

Re: reducer tasks long time

Re: Upgrade spark 1.5 to 1.6 HDP 2.3

Re: How to upgrade HDP spark version

Re: reducer tasks long time

Re: Python - How to Install?

Re: sparkR - Error in socketConnection(port = moni...

Re: Upgrade spark 1.5 to 1.6 HDP 2.3