Member since
07-31-2013
1924
Posts
462
Kudos Received
311
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2129 | 07-09-2019 12:53 AM | |
| 12450 | 06-23-2019 08:37 PM | |
| 9561 | 06-18-2019 11:28 PM | |
| 10526 | 05-23-2019 08:46 PM | |
| 4897 | 05-20-2019 01:14 AM |
05-09-2017
06:53 AM
Yes Harsh, it's number of blocks. Block count is 6 Million. Deleted unwanted small files, now the cluster health is good Is there any limit that a datanode should have only x no. of blocks?
... View more
05-07-2017
12:10 PM
I am having the same problem! Where did you change the name of the server exactly? Can you please give more details? Thanks in advance
... View more
05-04-2017
01:20 PM
i have added one node and tried hadoop fs -setrep -w 3 / it is working..... no under Replicas.......
... View more
04-06-2017
07:40 AM
use lsof command, and you should be able to see all the open files
... View more
03-18-2017
04:32 AM
1 Kudo
Hue's access permission model does not yet allow you to control action types - just the Oozie app on the whole. This would be a feature request if you're looking to control this at a specific user/group level. You can log a JIRA with your desired use-case in detail at https://issues.cloudera.org/browse/HUE. If you're instead looking to ban the whole action, you can reconfigure Oozie Server's oozie-site.xml to override the default list of 'extra' action executors: https://github.com/cloudera/oozie/blob/cdh5.10.0-release/core/src/main/resources/oozie-default.xml#L1608-L1630. The action type icons may still appear on the Hue UI but running them would fail.
... View more
03-16-2017
01:45 PM
Regarding where to host the 3 journal nodes using QJM: Apache docs (and similarly in Cloudera HA guide) state: The JournalNode daemon is relatively lightweight, so these daemons may reasonably be collocated on machines with other Hadoop daemons, for example NameNodes, the JobTracker, or the YARN ResourceManager My 2 NameNode machines are not good candidates for hosting 2 of the 3 daemons due the recommendation that these have a dedicated disk drive. So with those out of the picture, the question circulating around my team is whether we can put these 3 daemons on nodes running data node daemons OR if we should dedicate 3 small virtual machines to running them. To me, 3 new VMs is overkill. Note that we have YARN RM on a datanode as well due to the small size of the cluster. Thanks for your input and if there are better suggestions, please let me know.
... View more
03-02-2017
07:23 AM
2 Kudos
Bit late to reply, but if the cluster is secure, try pointing the hbase configuration to the spark driver and executor classpath explicitly using 'spark.executor.extraClassPath' and 'spark.driver.extraClassPath'. Also make sure that the host from where you are running the spark command has the gateway role added. Example: $ pyspark --jars /opt/cloudera/parcels/CDH/jars/spark-examples-1.6.0-cdh5.7.3-hadoop2.6.0-cdh5.7.3.jar,/opt/cloudera/parcels/CDH/jars/hbase-examples-1.2.0-cdh5.7.3.jar --conf "spark.executor.extraClassPath=/etc/hbase/conf/" --conf "spark.driver.extraClassPath=/etc/hbase/conf/"
... View more