Member since
09-29-2015
58
Posts
34
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
970 | 09-29-2016 01:39 PM | |
2174 | 06-21-2016 03:10 PM | |
6627 | 05-16-2016 07:12 PM | |
8690 | 04-08-2016 02:06 PM | |
1159 | 04-08-2016 01:56 PM |
05-16-2016
07:01 PM
@Tim Veil I believe the REST API for the scheduler only supports GET operations as per https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html
... View more
05-03-2016
01:01 PM
Hi @Vinay MP , It seems you are not able to contact the ResourceManager. What port is RM listening on? You should be able to do a ps -ef | grep resourcemanager and then do a netstat -tulpn | grep <PID> to find out.
... View more
04-13-2016
12:07 PM
@Ryan Cicak The sandbox provides many of the defaults used during normal installation. You can change the 3x replication in the configs but the sandbox is mainly to allow usage of the tutorials.
... View more
04-08-2016
06:42 PM
@Arvind Kandaswamy it is complaining about the ping port listener. This is not port 8080 but is defined in your /etc/ambari-agent/conf/ambari-agent.ini. It is normally port 8670. Try running netstat -tulpn | grep 8670 to see what is on that port.
... View more
04-08-2016
03:05 PM
1 Kudo
@Saurabh Kumar To add to this, you could investigate third party dev projects such as https://github.com/nmilford/clean-hadoop-tmp
... View more
04-08-2016
02:06 PM
2 Kudos
Hi @Alena Melnikova , there is a capacity and max capacity. The max is what determines elasticity but setting that alone is not enough. That is at queue level. You have to adjust the user-limit-factor so that a user can leverage more than just the capacity. You essentially are saying that a user can use X times capacity. For example, if you say 2 for user-limit-capacity in this example, the user will be able to leverage 80 percent (40x2) Capacity is the queue ceiling, you cannot set to 100 as the queues have to add up to 100 across root. I hope this helps. Ian
... View more
04-08-2016
01:56 PM
Please try to execute the command manually on the node and see what it returns: conf-select set-conf-dir --package hadoop --stack-version 2.4.0.0-169 --conf-version 0 This also looks specific to the environment: sudo:no tty present andno askpass program specified. You could try manually starting on the node which may give more details.
... View more
02-23-2016
03:13 PM
1 Kudo
The release of HDP 2.3.4 offers a newer version of the ATS which is version 1.5. Part of configuring this new ATS version includes providing the following property if Tez is used: <property>
<name>yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes</name>
<value>org.apache.tez.dag.history.logging.ats.TimelineCachePluginImpl</value>
<description>Plugins that can translate a timeline entity read request into a list of timeline cache ids, separated by commas. </description> </property> If this property is included but the tez-client is not present, a message will be seen in the ATS log stating ClassNotFound and the ATS server will fail shortly after issuing a startup. The full documentation for configuring ATS 1.5 is located here: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_yarn_resource_mgt/content/ch08s02.html A documentation bug has been filed as the only reference to this in the configuration section is this: "The Tez cache plugin class must be in the timeline server’s classpath."
... View more
Labels:
02-23-2016
02:22 PM
What are the permissions on python ls -ltr /home/centos/apps/pyspark/venv/bin
... View more
02-23-2016
02:04 PM
What are the permissions on /home/centos/apps/pyspark/venv/bin/python?
... View more
- « Previous
- Next »