we are using HDP cluster with *182* `data node` machines   *HDP version - 2.6.4 Ambari version 2.6.1*   we notes the following behavior on the `data nodes` machines ( its happens on all `data-node` machines and on all disks )   when we perform the command as above example:   ps -eo s,user,cmd | grep ^[RD] D hdfs du -sk /grid/sdj/hadoop/hdfs/data/current/BP-1018134753-10.3.6.170-1530088122990 D hdfs du -sk /grid/sdm/hadoop/hdfs/data/current/BP-1018134753-10.3.6.170-1530088122990 R root ps -eo s,user,cmd   Note - each disk in the `data node` is `5.4 T Bytes`   we can see that `HDFS` is running the "du -sk" on the `data node` disks we don't so like this , because the meaning of that is consuming high load CPU Avrg and sometimes even bad performance   we are understand that `HDFS` need to run the "`du -sk`" in order to verify the disks space , **but** on other hand its cost - high CPU load avrg and sometimes even poor performance so - is it possible to tell `HDFS` in some way to disable this verification ?   ... View more

we can see from our `RHEL 7.6` server ( kernel version - `3.10.0-957.el7.x86_64` ) that following process are with `D` state ( they runs from `HDFS` user )   Note - *D state code means that process is in uninterruptible sleep*   ps -eo s,user,cmd | grep ^[RD] D hdfs du -sk /grid/sdj/hadoop/hdfs/data/current/BP-1018134753-10.3.6.170-1530088122990 D hdfs du -sk /grid/sdm/hadoop/hdfs/data/current/BP-1018134753-10.3.6.170-1530088122990 R root ps -eo s,user,cmd   note's - the disks `sdj` and `sdm` are `3T` byte size , also `"du -sk`" happens on other disks as `sdd , sdf` etc   we are suspect that the fact that we have high CPU load avrg is because the "du -sk" that actually run on the disks   so I was thinking what we can do regarding to below behavior   one option is maybe to disable the "`du -sk`" verification from `HDFS` , but no clue how to do that second option is to think what actually cause the `D` state ?   I don't sure ... but maybe upgrade the kernel version will help to avoid D state? or else? ( like disable the CPU Thread(s) ) , etc ?   more details lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 48 On-line CPU(s) list: 0-47 Thread(s) per core: 2 Core(s) per socket: 12 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 and CPU LOAD AVRG is around ~ 42-45 ( for 15min avrg )   Reference :   https://community.cloudera.com/t5/Support-Questions/Does-hadoop-run-dfs-du-automatically-when-a-new-job-starts/td-p/231297 https://community.cloudera.com/t5/Support-Questions/Can-hdfs-dfsadmin-and-hdfs-dsfs-du-be-taxing-on-my-cluster/m-p/182402 https://community.pivotal.io/s/article/Dealing-with-Processes-in-State-D---Uninterruptible-Sleep-Usually-IO?language=en_US ... View more

we have HDP cluster ( Hadoop cluster version 2.6.5 ) and we add the ranger and ranger KMS to the cluster as services after adding the service - ranger KMS and do some settings we performed the following   [hdfs@worker01 tmp]$ hdfs dfs -mkdir /zone_encr_1 [hdfs@worker01 tmp]$ hdfs crypto -createZone -keyName secret_hdp1 -path /zone_encr_1 Added encryption zone /zone_encr_1 [hdfs@worker01 tmp]$ hdfs dfs -copyFromLocal file.txt /zone_encr_1 [hdfs@worker01 tmp]$ hdfs dfs -cat /zone_encr_1/file.txt hello every one [hdfs@worker01 tmp]$ hdfs dfs -ls /zone_encr_1/file.txt -rw-r--r-- 2 hdfs hdfs 23 2021-11-24 20:19 /zone_encr_1/file.txt [hdfs@worker01 tmp]$ hdfs crypto -listZones /zone_encr secret_hdp1 /zone_encr_new secret_hdp1 /zone_encr_1 secret_hdp1 as we can see above first we create folder - /zone_encr_1 under hdfs then we add encryption to folder - /zone_encr_1 then we copy from local folder the file - file.txt that include the text - "hello every one" to hdfs folder - /zone_encr_1 then we do the test with `hdfs dfs -cat /zone_encr_1/file.txt` and we expect to get encrypted file , but we not   we still get the file as   hello every one since I just to learn the ranger KMS capabilities , I am not sure if I missed something       https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.1/bk_security/content/copy-to-from-encr-zone.html ... View more

hi all   we have Kafka server with version 2.6 on Linux rhel machine    what is wrong with the following Kafka cli   kafka-topics.sh --bootstrap-server="kafka1:6667" --describe|more Error while executing topic command : The broker does not support DESCRIBE_CONFIGS [2021-09-02 11:19:02,486] ERROR org.apache.kafka.common.errors.UnsupportedVersionException: The broker does not support DESCRIBE_CONFIGS (kafka.admin.TopicCommand$)   is above cli - is valid approach ?  ... View more

we have hadoop cluster with 374 datanode machine ( HDP version 2.6.5 with ambari 2..6.2.2 ) each datanode have 12 disks when each disk is 15T we noticed that du -sk is running periodically from hdfs user on each data-node server we understand that using of the du -sk command is to count the size of BP. but this operation will take a long time (maybe more than 10-30 minutes , since we have each disk with size of 15T) so on a large hard disk machine. This will lead to an increase in iowait and load. is there any option to disable the running of du ? or at least to find the configuration that runs the du and re-configure it so du will runs each 3 hours instead of each couple min? ... View more

we have Kafka cluster with different versions   kafka cluster confluent with version 1.0 kafka cluster Apache with version 2.7     we want to test the leader if balance on our topics the target is verify on each topic that leaders are balanced to partitions here is example when Kafka broker leaders are balanced we can see that we have 4 (1001 ) , 3 (1002 ) , 3 ( 1003 )   Topic:drive.car.cost.val PartitionCount:10 ReplicationFactor:3 Configs:segment.bytes=53687091,retention.bytes=53687091 Topic: drive.car.cost.val Partition: 0 Leader: 1001 Replicas: 1001,1002,1003 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 1 Leader: 1002 Replicas: 1002,1003,1001 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 2 Leader: 1003 Replicas: 1003,1001,1002 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 3 Leader: 1001 Replicas: 1001,1003,1002 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 4 Leader: 1002 Replicas: 1002,1001,1003 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 5 Leader: 1003 Replicas: 1003,1002,1001 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 6 Leader: 1001 Replicas: 1001,1002,1003 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 7 Leader: 1002 Replicas: 1002,1003,1001 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 8 Leader: 1003 Replicas: 1003,1001,1002 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 9 Leader: 1001 Replicas: 1001,1003,1002 Isr: 1001,1002,1003 and here is example that leader brokers are not balanced we can see that we have 1 (1001 ) , 2 (1002 ) , 7 ( 1003 ) Topic:drive.car.cost.val PartitionCount:10 ReplicationFactor:3 Configs:segment.bytes=53687091,retention.bytes=53687091 Topic: drive.car.cost.val Partition: 0 Leader: 1001 Replicas: 1001,1002,1003 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 1 Leader: 1002 Replicas: 1002,1003,1001 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 2 Leader: 1003 Replicas: 1003,1001,1002 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 3 Leader: 1003 Replicas: 1001,1003,1002 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 4 Leader: 1003 Replicas: 1002,1001,1003 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 5 Leader: 1003 Replicas: 1003,1002,1001 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 6 Leader: 1003 Replicas: 1001,1002,1003 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 7 Leader: 1002 Replicas: 1002,1003,1001 Isr: 1002,1001,1003 Topic: drive.car.cost.val Partition: 8 Leader: 1003 Replicas: 1003,1001,1002 Isr: 1001,1002,1003 Topic: drive.car.cost.val Partition: 9 Leader: 1003 Replicas: 1001,1003,1002 Isr: 1001,1002,1003 so we build python script that count and calculate the kafka leaders , and verify if we have balanced but I want to know if kafka itself have some cli that can tell us if leaders are balanced per partition   ... View more

in yarn configuration , we have the following parameters ( according to https://hadoop.apache.org/docs/r2.7.6/hadoop-yarn/hadoop-yarn-common/yarn-default.xml )     yarn.resourcemanager.webapp.address ${yarn.resourcemanager.hostname}:8088 The http address of the RM web application. yarn.resourcemanager.webapp.https.address ${yarn.resourcemanager.hostname}:8090 The https adddress of the RM web application. yarn.resourcemanager.resource-tracker.address ${yarn.resourcemanager.hostname}:8031   we are not sure about how to set the hostname   for example   we can set the parameter: yarn.resourcemanager.webapp.address   as   master01.formula45.com:8088 ( when master01.formula45.com is the hostname of the machine that resource manager is installed)   or maybe better as   0.0.0.0:8088     references: https://superuser.com/questions/949428/whats-the-difference-between-127-0-0-1-and-0-0-0-0 https://serverfault.com/questions/78048/whats-the-difference-between-ip-address-0-0-0-0-and-127-0-0-1               ... View more

We have HDP cluster with version `2.6.5` Cluster include 2 resource-manager services that are part of YARN Cluster was working fine in the last 2 years , but today we noticed that we cant access port `8088` from Ambari In Ambari we can see that one resource manager is active and the second is standby , when the first resource manger is on master01 machine , and the second is on master02 machine From the resource manager logs we can see the following logs       2021-07-16 09:12:14,974 ERROR mortbay.log (Slf4jLog.java:warn(87)) - /ws/v1/cluster/apps javax.ws.rs.WebApplicationException: javax.xml.bind.MarshalException - with linked exception: [javax.xml.stream.XMLStreamException: org.mortbay.jetty.EofException] at com.sun.jersey.core.provider.jaxb.AbstractRootElementProvider.writeTo(AbstractRootElementProvider.java:159) at com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437) Caused by: javax.xml.bind.MarshalException - with linked exception: [javax.xml.stream.XMLStreamException: org.mortbay.jetty.EofException] at com.sun.xml.bind.v2.runtime.MarshallerImpl.write(MarshallerImpl.java:327) at com.sun.xml.bind.v2.runtime.MarshallerImpl.marshal(MarshallerImpl.java:177) at com.sun.jersey.json.impl.BaseJSONMarshaller.marshallToJSON(BaseJSONMarshaller.java:103) at com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider.writeTo(JSONRootElementProvider.java:136) at com.sun.jersey.core.provider.jaxb.AbstractRootElementProvider.writeTo(AbstractRootElementProvider.java:157) ... 45 more 2021-07-16 09:12:15,077 ERROR mortbay.log (Slf4jLog.java:warn(87)) - /ws/v1/cluster/apps javax.ws.rs.WebApplicationException: javax.xml.bind.MarshalException - with linked exception: [javax.xml.stream.XMLStreamException: org.mortbay.jetty.EofException]. . . Caused by: javax.xml.bind.MarshalException - with linked exception: [javax.xml.stream.XMLStreamException: org.mortbay.jetty.EofException] at com.sun.xml.bind.v2.runtime.MarshallerImpl.write(MarshallerImpl.java:327) at com.sun.xml.bind.v2.runtime.MarshallerImpl.marshal(MarshallerImpl.java:177) at com.sun.jersey.json.impl.BaseJSONMarshaller.marshallToJSON(BaseJSONMarshaller.java:103) at com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider.writeTo(JSONRootElementProvider.java:136) at com.sun.jersey.core.provider.jaxb.AbstractRootElementProvider.writeTo(AbstractRootElementProvider.java:157) ... 45 more       As I know the most common reason I've had for a "broken pipe" is that one machine (of a pair communicating via socket) has shut down its end of the socket before communication was complete. But we not understand why ( YARN ) resource manager failed about “Broken pipe” From Ambari when we access to yarn –-> config , we can see the parameters that relevant to port 8088   yarn.resourcemanager.webapp.address master01.BD101.com:8088 yarn.resourcemanager.webapp.address.rm1 master01.BD101.com:8088 yarn.resourcemanager.webapp.address.rm2 master02.BD101.com:8088   so we not sure if our problem related but , maybe better to use the IP as `0.0.0.0` instead the host-name of machine ? the situation for now is that we stop the resource manager on master01 machine , and restart the resource manager on master02 machine , so for now we can access the web page by VIA port `8088` but when both resource manager are up as one active and the second is standby then the problem return again and we cant access port `8088` in order to get ambari web page any idea about how to find solution for this problem?       ... View more

we have Hadoop cluster ( HDP 2.6.5 cluster with ambari , with 25 datanodes & nodemanager machines ) we are using spark streaming application (spark 2.1 run over Hortonworks 2.6.x ) the current situation is that spark streaming applications runs on all datanodes & node-manager machines but from the   resources manager   logs we see the following INFO warning:   2021-06-27 14:07:01,456 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0004 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,456 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0003 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,456 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0009 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 regarding to   Reservation Exceeds Allowed number of nodes what is the customization that we should to do in order to avoid above those messages? ... View more

we have 2 resource managers that are working as part of HDP cluster the first resource manager is failed after couple minutes from the log of the resource manager we can see the following lines that returned many times   2021-06-27 14:07:16,022 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(152)) - Assigned container container_e83_1624802728037_0001_01_004355 of capacity <memory:86016, vCores:5> on host datanode23.fgtf.com:45454, which has 5 containers, <memory:199680, vCores:15> used and <memory:27708, vCores:75> available after allocation 2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0001 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0004 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0003 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes:     AND   2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0001 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0004 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0003 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10 2021-06-27 14:07:01,279 INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: and 2021-06-27 14:07:01,282 INFO webproxy.WebAppProxyServlet (WebAppProxyServlet.java:doGet(382)) - dr.who is accessing unchecked http://22.20.101.13:53092/api/v1/applications/application_1624802728037_0009/executors which is the app master GUI of application_1624802728037_0009 owned by hdfs 2021-06-27 14:07:01,282 INFO webproxy.WebAppProxyServlet (WebAppProxyServlet.java:doGet(382)) - dr.who is accessing unchecked http://22.20.14.5:36198/api/v1/applications/application_1624801538018_0011/executors which is the app master GUI of application_1624801538018_0011 owned by hdfs any idea what is the meaning of the INFO about? INFO fair.FSAppAttempt (FSAppAttempt.java:reservationExceedsThreshold(495)) - Reservation Exceeds Allowed number of nodes: app_id=application_1624802728037_0001 existingReservations=10 totalAvailableNodes=181 reservableNodesRatio=0.05 numAllowedReservations=10   ... View more

  in Ambari we have the following feature that is disable , under yarn Configs what is the relevant ambari rest api in order to change the state of CPU Scheduling from disable to enable ? ... View more

hi all     we are trying to download the ambari version 2.6.1 but without success ( according to https://docs.hortonworks.com.s3.amazonaws.com/HDPDocuments/HDF3/HDF-3.1.1/bk_installing-hdf-on-hdp-ppc/content/ambari_repositories.html )    wget http://public-repo-1.hortonworks.com/ambari/centos7-ppc/2.x/updates/2.6.1.0 --2021-02-16 14:44:08-- http://public-repo-1.hortonworks.com/ambari/centos7-ppc/2.x/updates/2.6.1.0 Resolving public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)... 13.225.255.100, 13.225.255.128, 13.225.255.124, ... Connecting to public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)|13.225.255.100|:80... connected. HTTP request sent, awaiting response... 403 Forbidden 2021-02-16 14:44:09 ERROR 403: Forbidden.   any idea why this version cant be download?   but we can download from other site as   wget http://archive.apache.org/dist/ambari/ambari-2.6.1/apache-ambari-2.6.1-src.tar.gz ... View more

We have ambari cluster , HDP version 2.6.5   Cluster include management of two name-node ( one is active and the secondary is standby ) And 65 datanode machines   We have problem with the standby name-node that not started and from the namenode logs we Can see the following   2021-01-01 15:19:43,269 ERROR namenode.NameNode (NameNode.java:main(1783)) - Failed to start namenode. java.io.IOException: There appears to be a gap in the edit log. We expected txid 90247527115, but got txid 90247903412. from ambari we can see    For now the active namenode is up but the standby name node is down , and the root cause for This issue is because **namenode matadata is damaged/corrupted.** So we have two solution - A or B   A)   run the following recover on standby namenode su hadoop namenode -recover   B)   Put Active NN in safemode su hdfs hdfs dfsadmin -safemode enter Do a savenamespace operation on Active NN su hdfs hdfs dfsadmin -saveNamespace Leave Safemode su hdfs hdfs dfsadmin -safemode leave Login to Standby NN Run below command on Standby namenode to get latest fsimage that we saved in above steps. su hdfs hdfs namenode -bootstrapStandby -force what is the preferred solution ( solution A or Solution B ) for our problem?  ... View more

we have Hadoop cluster with 2 name-nodes ( active standby ) and 12 data nodes   all 12 data-nodes machines have disks for HDFS   we are before the action of `hadoop namenode -recover` , and that because we suspect about corrupted files as fsimage_0000000000001253918 or edits_0000000000001203337-0000000000001214475 etc   so to recover the hdfs meta data we can do the following           $ hadoop namenode -recover DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 21/01/19 17:56:35 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: user = hdfs STARTUP_MSG: host = master1.sys67.com/17.2.12.78 STARTUP_MSG: args = [-recover] STARTUP_MSG: version = 2.7.3.2.6.5.0-292 21/01/19 17:56:35 INFO namenode.NameNode: createNameNode [-recover] You have selected Metadata Recovery mode. This mode is intended to recover lost metadata on a corrupt filesystem. Metadata recovery mode often permanently deletes data from your HDFS filesystem. Please back up your edit log and fsimage before trying this! Are you ready to proceed? (Y/N) (Y or N) y           the question is: dose this action could also affected the data itself on the data-nodes machines ?   or only the meta data on namenode machines? ... View more

we have ambari cluster , HDP version `2.6.5`   cluster include management of two name-node ( one is active and the secondary is standby ) and 65 datanode machines   we have problem with the standby name-node that not started and from the namenode logs we can see the following   2021-01-01 15:19:43,269 ERROR namenode.NameNode (NameNode.java:main(1783)) - Failed to start namenode. java.io.IOException: There appears to be a gap in the edit log. We expected txid 90247527115, but got txid 90247903412. at org.apache.hadoop.hdfs.server.namenode.MetaRecoveryContext.editLogLoaderPrompt(MetaRecoveryContext.java:94) at org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.loadEditRecords(FSEditLogLoader.java:215)       for now the active namenode is up but the standby name node is down   regarding to java.io.IOException: There appears to be a gap in the edit log. We expected txid 90247527115, but got txid 90247903412.   what is the preferred solution to fix this problem?   ... View more

we have HDP cluster version `2.6.5` with `8` data nodes , all machines are installed on rhel 7.6 version   HDP cluster is based amabri platform version - `2.6.1`   each data-node ( worker machine ) include two disks and each disk size is 1.8T   when we access the data-node machines we can see differences between the size of the disks   for example on the first data-node the size is : ( by `df -h` )   /dev/sdb 1.8T 839G 996G 46% /grid/sdc /dev/sda 1.8T 1014G 821G 56% /grid/sdb   on the second data-node the size is: /dev/sdb 1.8T 1.5T 390G 79% /grid/sdc /dev/sda 1.8T 1.5T 400G 79% /grid/sdb   on the third data-node th size is: /dev/sdb 1.8T 1.7T 170G 91% /grid/sdc /dev/sda 1.8T 1.7T 169G 91% /grid/sdb   and so on   the big question is why HDFS not perform the re-balance on the HDFS disks?   *for example expected results on all disks should be with the same size on all datanodes machines* why is the used size differences between `datanode1` to `datanode2` to `datanode3` etc ?   any advice about the tune parameters in HDFS that can help us?   *because its very critical when one disk is reached `100%` size and the other are more small as `50%`* ... View more

hi all   we have ambari cluster with HDP version 2.6.5   from ambari dashboard we see  the following     we can see that YARN show 111% - this isn't logical value   instead to show X from 100%   what could be the problem here ? ... View more

hi all   the following post in you-tube described how to add the hbase in ambari with all component on specific hosts   https://www.youtube.com/watch?v=BsvLoPE0XOk   what we want to do is exactly the same but with ambari rest API   since the target is to use script and create by REST API the Hbase service with  Hbase component as the following example     we will happy to get examples of REST API  ... View more