Cloudera Community
Announcements
Now Live: Explore expert insights and technical deep dives on the new Cloudera Community Blogs — Read the Announcement
jsensharma
user rank
user rank
Master Mentor

Re: install start and test ambari warning

by Master Mentor Master Mentor in Support Questions
‎03-07-2018 05:24 AM
‎03-07-2018 05:24 AM
@Aymen Rahal Looks like you have installed all those services to a Single Host. So your Host needs to be more powerful Like it should have Enough RAM to run all those services together. So please check the resources available on your Host "hadoop" to see if it has enough memory free ? Else Ambari will install those services (binaries) but will not be able to start them together due to memory issue). In this case it looks like the component/services installation was successful but ambari was not able to start then successfully (may be due to some resource constraint, or other errors) So you should take a look at the individual component logs Like Look at the NameNode log (if NameNode failed to start, Similarly look at the DataNode log if that was not started ....etc). . ... View more

Re: install start and test ambari warning

by Master Mentor Master Mentor in Support Questions
‎03-07-2018 05:08 AM
‎03-07-2018 05:08 AM
@Aymen Rahal No, it is not normal. You should click on the "Warning encountered" link to see what went wrong (Ignoring these warnings and clicking to "Next" may have some consequences later). It will also be good to take a look at your ambari server logs to see if there is any warning/error. Looking at the Agent logs of that particular host also will give us more idea. ... View more

Re: Unable to download client config files from Am...

by Master Mentor Master Mentor in Support Questions
‎03-06-2018 11:05 PM
‎03-06-2018 11:05 PM
@Leonardo Apolonio Either you will need to run ambari server azs "root" user. (OR) You will need to configure the non root user "hydra" in the "sudoer" list. . Regarding your query: "Does ambari-server user need sudo privileges?" If using non root user then yes, ambari server's user needs to be configured as sudo user. Please refer to the following docs: (Ambari server Sudoer config) 1. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/sudo_defaults_server.html 2. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/sudoer_configuration_server.html 3. List of commands: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/commands_server.html 4. Sudo Defaults for Ambari Server: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/sudo_defaults_server.html . ... View more

Re: how to find the right value of MTU Jumbo frame

by Master Mentor Master Mentor in Support Questions
‎03-06-2018 05:53 AM
‎03-06-2018 05:53 AM
@Michael Bronson Regarding your following query: hortonworks recommendation about the MTU value ? >>> Unfortunately i did not find any such document/guide which can give the value for MTU on Hortonworks Component cluster. As it's a tuning parameter and it completely depends on how the network equipment's are capable of handling jumbo frames. The value may vary based on N/W equipment's types and type of N/W. Too large an MTU size may mean retransmission's of packets if the packet encounters a router that can't handle that large a packet. Too small an MTU size means relatively more header overhead and more acknowledgements that have to be sent and handled. More than the operating system (like RedHat Linux) it applies to communications protocols and network layers (Datalink Layer/Ethernet frame). . If your network can support 9000 MTU then you can go ahead with it. You might need to monitor the Network packet drops initially to see there is no issue with N/W device communication. ... View more

Re: how to find the right value of MTU Jumbo frame

by Master Mentor Master Mentor in Support Questions
‎03-06-2018 05:07 AM
1 Kudo
‎03-06-2018 05:07 AM
1 Kudo
@Michael Bronson The value of MTU depends on the network devices that are going to take e part in the communication. like Routers / machines. The following link explains how to set the MTU value and how to deter mine it's value based on our network devices standards. Reference: https://www.tp-link.com/us/article/?faqid=190 http://www.microhowto.info/howto/change_the_mtu_of_a_network_interface.html http://www.geekprojects.org/2015/07/increase-centos-7s-mtu/ Good visual Explain: https://www.youtube.com/watch?v=Y6IMlPSl4fI https://www.youtube.com/watch?v=LeaEmOUVEn0 Important Notes: - Due to additional complications, VPNs require a different type of MTU test. - If you have a network with multiple PCs every computer should be set up with the same MTU. Additionally, some PCs may use several Network Adapters or a VPN client adapter on one PC so you must verify you are changing the Network Adapter associated with your broadband service or VPN client. - The built in PPPoE client for Windows XP uses an MTU that is set to 1480 (1500). . ... View more

Re: dose we need to set huge pages on all nodes in...

by Master Mentor Master Mentor in Support Questions
‎03-06-2018 05:02 AM
‎03-06-2018 05:02 AM
@Michael Bronson The following link explains how to set the MTU value and how to deter mine it's value based on our network devices standards. https://www.tp-link.com/us/article/?faqid=190 ... View more

Re: how to run zookeeper service check VIA REST AP...

by Master Mentor Master Mentor in Support Questions
‎03-05-2018 11:53 PM
‎03-05-2018 11:53 PM
@Michael Bronson For the script based Zookeeper Service check , I have added a response here: https://community.hortonworks.com/questions/176909/ambari-trigger-service-checkspy-bug.html?childToView=176948#comment-176948 . ... View more

Re: ambari_trigger_service_checks.py bug

by Master Mentor Master Mentor in Support Questions
‎03-05-2018 11:37 PM
‎03-05-2018 11:37 PM
@Michael Bronson After the fix you should see the Zookeeper Service check passes as following: # python ambari_trigger_service_checks.py -u admin -p admin -C plain_ambari --services=ZOOKEEPER --wait --timeout=500 2018-03-05 23:21:55,672 - utils.py[log_option:2203](8141) - INFO - timeout: 500 2018-03-05 23:21:55,673 - cli.py[main:159](8141) - INFO - Hari Sekhon ambari_trigger_service_checks.py version 0.2 => CLI version 0.9.1 => Utils version 0.11.2 2018-03-05 23:21:55,673 - cli.py[main:160](8141) - INFO - https://github.com/harisekhon/pytools 2018-03-05 23:21:55,673 - cli.py[main:161](8141) - INFO - verbose level: 2 (INFO) 2018-03-05 23:21:55,673 - utils.py[log_option:2203](8141) - INFO - timeout: 500 2018-03-05 23:21:55,673 - utils.py[log_option:2203](8141) - INFO - host: localhost 2018-03-05 23:21:55,673 - utils.py[log_option:2203](8141) - INFO - port: 8080 2018-03-05 23:21:55,674 - utils.py[log_option:2203](8141) - INFO - user: admin 2018-03-05 23:21:55,674 - utils.py[log_option:2203](8141) - INFO - password: <omitted> 2018-03-05 23:21:55,736 - utils.py[log_option:2203](8141) - INFO - cluster: plain_ambari 2018-03-05 23:21:55,799 - ambari_trigger_service_checks.py[request_service_checks:283](8141) - INFO - sending batch schedule check request for services: ZOOKEEPER 2018-03-05 23:21:55,979 - ambari_trigger_service_checks.py[request_service_checks:288](8141) - INFO - RequestSchedule 157 submitted 2018-03-05 23:21:55,989 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - NO STATUS YET: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:21:57,003 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:21:58,014 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:21:59,025 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:00,042 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:01,058 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:02,086 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:03,098 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:04,111 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:05,122 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:06,142 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:07,160 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:08,180 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:09,198 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:10,215 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:11,248 - ambari_trigger_service_checks.py[parse_scheduled_request:324](8141) - INFO - IN_PROGRESS: ZOOKEEPER_QUORUM_SERVICE_CHECK: ZOOKEEPER Service Check (batch 1 of 1) 2018-03-05 23:22:12,260 - ambari_trigger_service_checks.py[parse_scheduled_request:310](8141) - INFO - COMPLETED . ... View more

Re: ambari_trigger_service_checks.py bug

by Master Mentor Master Mentor in Support Questions
‎03-05-2018 11:33 PM
2 Kudos
‎03-05-2018 11:33 PM
2 Kudos
@Michael Bronson I have reviewed the "ambari_trigger_service_checks.py" script from here: https://github.com/HariSekhon/pytools/blob/master/ambari_trigger_service_checks.py#L366 And it looks like there is an issue with the Command name generation as the Zookeeper service name command name is actually "ZOOKEEPER_QUORUM_SERVICE_CHECK" and not "ZOOKEEPER_SERVICE_CHECK" . I have suggested a fix in the script here. https://github.com/HariSekhon/pytools/pull/5/files ( @Hari Sekhon ) . Fixed Script: So if you want to test the fix then please use this script from the following repo: https://github.com/jaysensharma/pytools/blob/Zookeeper_Service_Check_Branch/ambari_trigger_service_checks.py (Click here to download the script) ... View more

Re: how to run zookeeper service check VIA REST AP...

by Master Mentor Master Mentor in Support Questions
‎03-05-2018 09:05 PM
1 Kudo
‎03-05-2018 09:05 PM
1 Kudo
@Michael Bronson The Following HCC article shows how we can trigger the bulk service checks as wel as individual service checks using Ambari API. Ambari API - Run all service checks (bulk) : https://community.hortonworks.com/articles/11852/ambari-api-run-all-service-checks-bulk.html You can also choose a batch of selective Service checks to be triggered at once as described in https://gist.github.com/mr-jstraub/0b55de318eeae6695c3f#payload-to-run-all-service-checks ... View more
Contact Me
Community Statistics
Member Since ‎03-14-2016 01:07 PM
Last Visited
Posts 4,721
Kudos received 1096