Member since
01-23-2018
70
Posts
3
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1673 | 01-16-2019 10:05 AM | |
1984 | 10-23-2018 03:40 PM | |
3802 | 10-19-2018 10:30 AM | |
1119 | 10-16-2018 12:58 PM | |
3515 | 05-28-2018 06:34 AM |
01-22-2019
02:53 PM
I have the same problem. Did you solve it?
... View more
01-22-2019
02:34 PM
I can't connect with --bootstrap-server key, only with --zookeeper works. Obviously "ConsumeKafka processor" use "bootstrap" mod. Can i use zookeeper with "ConsumeKafka processor" or how can i debug why i can't to connect direct to broker? kafka-console-consumer.sh --bootstrap-server server:6667 --topic test5 --from-beginning --security-protocol SASL_PLAINTEXT
don't work kafka-console-consumer.sh --zookeeper server:2181--topic test5 --from-beginning --security-protocol SASL_PLAINTEXT
work fine
... View more
01-17-2019
02:54 PM
Hello, I have enable kerberos on cluster. I can successfully connect to consumer through kafka-konsole-consumer. But when i try to connect to topic through NiFi ConsumeKafka processor i have error: WARN [Timer-Driven Process Thread-8] o.a.n.p.kafka.pubsub.ConsumeKafka_1_0 ConsumeKafka_1_0[id=504e5811-0168-1000-0000-000024c83cc5] Was interrupted while trying to communicate with Kafka with lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@51911c24. Will roll back session and discard any partially received data. WARN [kafka-kerberos-refresh-thread-nifi/*@*] o.a.k.c.security.kerberos.KerberosLogin [Principal=nifi/*@*]: TGT renewal thread has been interrupted and will exit.
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi
01-16-2019
10:05 AM
My stupid mistake, i forgot what i had enabled manual commit in Dbeaver in production server and "upgrade_id" cell didn't update.
... View more
01-15-2019
02:59 PM
Maybe is that problem because one item in last update was failed? {
"href" : "http://*:8080/api/v1/clusters/DataLake/upgrades/865/upgrade_groups/434/upgrade_items/140",
"UpgradeItem" : {
"cluster_name" : "DataLake",
"command_params" : "{\"upgrade_pack\":\"nonrolling-upgrade-2.6\",\"clusterName\":\"DataLake\",\"upgrade_direction\":\"upgrade\",\"forceRefreshConfigTagsBeforeExecution\":\"true\",\"upgrade_type\":\"nonrolling_upgrade\",\"request_id\":\"865\"}",
"context" : "Save Cluster State",
"display_status" : "FAILED",
"end_time" : -1,
"group_id" : 434,
"host_params" : "{\"host_sys_prepped\":\"false\",\"agent_stack_retry_count\":\"5\",\"java_home\":\"/etc/alternatives/java_sdk\",\"jdk_location\":\"http://*.*.ru:8080/resources/\",\"stack_version\":\"2.6\",\"custom_postgres_jdbc_name\":\"postgresql-42.0.0.jar\",\"mysql_jdbc_url\":\"http://*:8080/resources//mysql-connector-java.jar\",\"oracle_jdbc_url\":\"http://*:8080/resources//ojdbc6.jar\",\"ambari_db_rca_password\":\"SECRET\",\"db_name\":\"ambari\",\"ambari_db_rca_driver\":\"org.postgresql.Driver\",\"ambari_db_rca_username\":\"ambari\",\"java_version\":\"8\",\"previous_custom_postgres_jdbc_name\":\"postgresql-42.0.0.jar\",\"not_managed_hdfs_path_list\":\"[\\\"/data/apps/hive/warehouse\\\",\\\"/data/app-logs\\\",\\\"/data/mr-history/done\\\",\\\"/tmp\\\"]\",\"db_driver_filename\":\"mysql-connector-java.jar\",\"gpl_license_accepted\":\"false\",\"agent_stack_retry_on_unavailability\":\"false\",\"ambari_db_rca_url\":\"jdbc:postgresql://*:5432/ambari\",\"stack_name\":\"HDP\"}",
"log_info" : null,
"progress_percent" : 100.0,
"request_id" : 865,
"skippable" : true,
"stage_id" : 140,
"start_time" : 1526474555466,
"status" : "COMPLETED",
"text" : "Save Cluster State"
},
"tasks" : [
{
"href" : "http://*:8080/api/v1/clusters/DataLake/upgrades/865/upgrade_groups/434/upgrade_items/140/tasks/11045",
"Tasks" : {
"cluster_name" : "DataLake",
"id" : 11045,
"request_id" : 865,
"stage_id" : 140
}
}
]
}
... View more
01-15-2019
01:21 PM
You are right. I just not carefully was reading documentation, not admin user can't view policy.
... View more
01-15-2019
01:10 PM
Hello, When installing new HDP version in Ambari, the following error is displayed: "Cluster <cluster_name> upgrade is in progress. Cannot install packages." I had tried to use instruction like this https://community.hortonworks.com/content/supportkb/177629/errorcluster-xyz-upgrade-is-in-progress-cannot-ins.html But not successfully. How can i work around this problem?
... View more
Labels:
10-23-2018
03:40 PM
Need to set next parameter into tez conf file: tez.am.view-acls=*
... View more
10-19-2018
10:30 AM
For kerberos connection needs to click on tab "windows" and type kerberos parameters What funny i thought this is just string, because default tab was "Username/Password" After this right windows realm, connection was success.
... View more
10-18-2018
04:16 PM
Since recently PoweBI is support spark "Direct Query" connection. Could anyone connect to spark in kerberized HDP cluster? In my case i have tried many different ways, but without success. My connection string is Server - spark thrift service fqdn and port, Protocol - Standard, Mode - DirectQuery In next dialog box contain my ActiveDirectory login and password. But connection is not success: Details: "ODBC: ERROR [28000] [Microsoft][ThriftExtension] (2) Error occured during authentication."
... View more
Labels:
- Labels:
-
Apache Spark