first thank you for your answer the reason that I ask this question is because the blueprint json file is with the logsearch configuration   as the following example   }, { "zookeeper-logsearch-conf" : { "properties_attributes" : { }, "properties" : { "component_mappings" : "ZOOKEEPER_SERVER:zookeeper", "content" : "\n{\n \"input\":[\n {\n \"type\":\"zookeeper\",\n \"rowtype\":\"service\",\n \"path\":\"{{default('/configurations/zookeeper-env/zk_log_dir', '/var/log/zookeeper')}}/zookeeper*.log\"\n }\n ],\n \"filter\":[\n {\n \"filter\":\"grok\",\n \"conditions\":{\n \"fields\":{\"type\":[\"zookeeper\"]}\n },\n \"log4j_format\":\"%d{ISO8601} - %-5p [%t:%C{1}@%L] - %m%n\",\n \"multiline_pattern\":\"^(%{TIMESTAMP_ISO8601:logtime})\",\n \"message_pattern\":\"(?m)^%{TIMESTAMP_ISO8601:logtime}%{SPACE}-%{SPACE}%{LOGLEVEL:level}%{SPACE}\\\\[%{DATA:thread_name}\\\\@%{INT:line_number}\\\\]%{SPACE}-%{SPACE}%{GREEDYDATA:log_message}\",\n \"post_map_values\": {\n \"logtime\": {\n \"map_date\":{\n \"target_date_pattern\":\"yyyy-MM-dd HH:mm:ss,SSS\"\n }\n }\n }\n }\n ]\n}", "service_name" : "Zookeeper" } } },   can we get advice about how to remove the logsearch configuration tag's from the blueprint json file ... View more

may I return to my first question until using redhat 7.2 , every thing was ok , after each scratch installation we never seen that but when we jump to redhat 7.5 then every cluster that created was with corrupted files - any HINT - why ? ... View more

Hi,   Did you checked what process is running on this port and tried killing the process if required?  if the issue got solved?   Thanks AKR ... View more

Hi,   Added to the above email because if there are too many old files are available in the SHS folder the cleaner may not work as expected. So the ideal way to be delete manually if there are too old .inprogress files.   Thanks AKR ... View more

Just note for HDP version - 3.1 , the spark version is - Apache Spark 2.3.2 and not 2.4 ... View more

Hi Mike,    The controller is responsible for administrative operations, including assigning partitions to brokers and monitoring for broker failures.   If we are getting no leaders assigned, one thing you can check is the controller status in the zookeeper cli.   To perform ZooKeeper CLI operations you can use the ZooKeeper client by "bin/zkCli.sh" after that execute: get /controller and see if the output is showing an active controller. If the output is showing "null" you can run rmr /controller, this will trigger a new controller assignment. Finally, make sure you don't have authorization issues by checking the server.log files during broker restart.   Regards, Manuel.   ... View more

@David Sanchez other thing please - can you help me with the post - https://community.hortonworks.com/questions/249557/is-it-necessary-to-restart-the-ambari-server-after.html ... View more

I will strongly suggest to reinstall the OS. They extra time you will spend (few hours max) is not worth it the thousand hours you will spend debuging in future. You will never be able to isolate or asses that the previous installation is not affecting you. Unless your case is very particular (e.g. You really DO NOT have access to the machine, etc... ), reinstall the OS and give yourself peace of mind. Nice guide though @Geoffrey Shelton Okot ... View more

@Jay as you know we are using script that use API to delete the service , so if no need to restart the ambari server , so I am understand that only deletion by API is that all needed and no need other additional steps - correct me i am I wrong ... View more

@Michael Bronson DEBUG/TRACE logging consumes much disk space. Hence it is better to disable them once you have collected enough race/debug logs for your troubleshooting purpose.. ... View more