@Geoffrey Shelton Okot I compared files, yes their exists and the same. ... View more

@Geoffrey Shelton Okot I set next acl on Dev cluster: [zk: localhost:2181(CONNECTED) 1] getAcl /brokers 'world,'anyone : cdrwa 'sasl,'kafka : cdrwa [zk: localhost:2181(CONNECTED) 2] getAcl /controller 'world,'anyone : r 'sasl,'kafka : cdrwa [zk: localhost:2181(CONNECTED) 3] getAcl /config 'world,'anyone : cdrwa 'sasl,'kafka : cdrwa [zk: localhost:2181(CONNECTED) 4] getAcl /config/topics 'world,'anyone : cdrwa 'sasl,'kafka : cdrwa but kafka-console-consumer.sh --bootstrap-server still not work. ... View more

@Geoffrey Shelton Okot Working Test: [zk: localhost:2181(CONNECTED) 0] getAcl /config/topics 'world,'anyone : r 'sasl,'kafka : cdrwa [zk: localhost:2181(CONNECTED) 1] Not working Dev: [zk: localhost:2181(CONNECTED) 0] getAcl /config/topics 'world,'anyone : cdrwa [zk: localhost:2181(CONNECTED) 1] ... View more

@Geoffrey Shelton Okot It's real case at my work. I configured Test cluster from Hortonworks documentation and everything works good but at the same time Development cluster with same configuration doesn't work and i don't understand why it is. I don't have lab or some special instruction but i can to show you anything my config files or screenshots. Is it maybe some problem with zookeeper? ... View more

@Geoffrey Shelton Okot I use HDF on HDP as one cluster, yes is kerberized. Ambari-2.6.2.2, HDP-2.6.5, HDF-3.1.2. ... View more

I can't connect with --bootstrap-server key, only with --zookeeper works. Obviously "ConsumeKafka processor" use "bootstrap" mod. Can i use zookeeper with "ConsumeKafka processor" or how can i debug why i can't to connect direct to broker? kafka-console-consumer.sh --bootstrap-server server:6667 --topic test5 --from-beginning --security-protocol SASL_PLAINTEXT don't work kafka-console-consumer.sh --zookeeper server:2181--topic test5 --from-beginning --security-protocol SASL_PLAINTEXT work fine ... View more

Maybe is that problem because one item in last update was failed? { "href" : "http://*:8080/api/v1/clusters/DataLake/upgrades/865/upgrade_groups/434/upgrade_items/140", "UpgradeItem" : { "cluster_name" : "DataLake", "command_params" : "{\"upgrade_pack\":\"nonrolling-upgrade-2.6\",\"clusterName\":\"DataLake\",\"upgrade_direction\":\"upgrade\",\"forceRefreshConfigTagsBeforeExecution\":\"true\",\"upgrade_type\":\"nonrolling_upgrade\",\"request_id\":\"865\"}", "context" : "Save Cluster State", "display_status" : "FAILED", "end_time" : -1, "group_id" : 434, "host_params" : "{\"host_sys_prepped\":\"false\",\"agent_stack_retry_count\":\"5\",\"java_home\":\"/etc/alternatives/java_sdk\",\"jdk_location\":\"http://*.*.ru:8080/resources/\",\"stack_version\":\"2.6\",\"custom_postgres_jdbc_name\":\"postgresql-42.0.0.jar\",\"mysql_jdbc_url\":\"http://*:8080/resources//mysql-connector-java.jar\",\"oracle_jdbc_url\":\"http://*:8080/resources//ojdbc6.jar\",\"ambari_db_rca_password\":\"SECRET\",\"db_name\":\"ambari\",\"ambari_db_rca_driver\":\"org.postgresql.Driver\",\"ambari_db_rca_username\":\"ambari\",\"java_version\":\"8\",\"previous_custom_postgres_jdbc_name\":\"postgresql-42.0.0.jar\",\"not_managed_hdfs_path_list\":\"[\\\"/data/apps/hive/warehouse\\\",\\\"/data/app-logs\\\",\\\"/data/mr-history/done\\\",\\\"/tmp\\\"]\",\"db_driver_filename\":\"mysql-connector-java.jar\",\"gpl_license_accepted\":\"false\",\"agent_stack_retry_on_unavailability\":\"false\",\"ambari_db_rca_url\":\"jdbc:postgresql://*:5432/ambari\",\"stack_name\":\"HDP\"}", "log_info" : null, "progress_percent" : 100.0, "request_id" : 865, "skippable" : true, "stage_id" : 140, "start_time" : 1526474555466, "status" : "COMPLETED", "text" : "Save Cluster State" }, "tasks" : [ { "href" : "http://*:8080/api/v1/clusters/DataLake/upgrades/865/upgrade_groups/434/upgrade_items/140/tasks/11045", "Tasks" : { "cluster_name" : "DataLake", "id" : 11045, "request_id" : 865, "stage_id" : 140 } } ] } ... View more