Member since
02-03-2016
119
Posts
55
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2570 | 07-04-2018 07:11 AM | |
4278 | 07-04-2018 06:48 AM | |
1204 | 06-30-2018 06:50 PM | |
2462 | 04-04-2018 03:07 AM | |
2469 | 06-06-2016 07:28 AM |
05-19-2016
07:27 AM
Hi Guys,
I have an issue on Ambari Metrics displaying kafka metrics. It doesnt show kafka metrics but it does have host metrics.
Upon checking on API, it doesn't show any compare to other components.
Please help where to start to fix it. Thank you!
Ambar 2.2.0
HDP-2.3.2
http://metric.server.com:8080/api/v1/clusters/MyCluster/services/KAFKA/components/KAFKA_BROKER {"href": "http://metric.server.com:8080/api/v1/clusters/MyCluster/services/KAFKA/components/KAFKA_BROKER","ServiceComponentInfo": {"category": "MASTER","cluster_name": "MyCluster","component_name": "KAFKA_BROKER","installed_count": 0,"service_name": "KAFKA","started_count": 1,"state": "STARTED","total_count": 1},"host_components": [{"href": "http://metric.server.com:8080/api/v1/clusters/MyCluster/hosts/kafka.server.com/host_components/KAFKA_BROKER","HostRoles": {"cluster_name": "MyCluster","component_name": "KAFKA_BROKER","host_name": "r6r41kafka.manila.exist.com"}}]}
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Kafka
05-19-2016
03:14 AM
Thanks @yusaku! Tried it and it's working. Just had some issues with some components. They're not working (eg KAFKA). Thanks for the guide!
... View more
05-19-2016
03:10 AM
I'm using kafka-graphite now (still exploring it. :] ). I'm also using grafana to fetch the graphs from graphite. 🙂 http://docs.grafana.org
🙂
... View more
05-19-2016
01:17 AM
I had a same issue yesterday, and it was fixed by changing mode from embedded to distributed as mentioned by @Pradeep kumar, except I did not change the hbase.zookeeper.property.clientPort to 2181. http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_ambari_reference_guide/content/ams_collector_modes.html
... View more
05-13-2016
01:06 AM
@ovidiu Your kafka version is actually 0.9.0 only. On my cluster, our kafka version is 0.9.0.2.3. It's Kafka 0.9.0 + HDP 2.3
... View more
04-27-2016
08:46 AM
We're currently using HDP 2.3.2. How can we manually upgrade the kafka to 0.9.x? Thank in advance!
... View more
Labels:
- Labels:
-
Apache Kafka
03-23-2016
12:31 AM
Thank you @mclark, for the very detailed answer-recommendation.
We'll try your recommendation today and will post results. Kudos!
... View more
03-23-2016
12:29 AM
Kafka version on HDP 2.3.2 is v0.8.2 as confirmed by Subhasis, Ratish and Dev from Hortonworks.
... View more
03-22-2016
07:41 AM
1 Kudo
Hi All! We're having error logs (see below) on our Nifi 0.4.0 on PutKafka Processor. See our config Mode: Synchronous Memory Max Buffer: 2GB Batch: 50 2016-03-21 23:00:08,269 ERROR [Timer-Driven Process Thread-10] o.apache.nifi.processors.kafka.PutKafka PutKafka[id=7709ebdc-07df-4469-a5a3-2b2ec9b35c26] Successfully sent 2 messages to Kafka but failed to send 1 messages; the last error received was org.apache.kafka.clients.producer.BufferExhaustedException: You have exhausted the 4294967296 bytes of memory you configured for the client and the client is configured to error rather than block when memory is exhausted.: org.apache.kafka.clients.producer.BufferExhaustedException: You have exhausted the 4294967296 bytes of memory you configured for the client and the client is configured to error rather than block when memory is exhausted. Any help is highly appreciated! Thanks in advance!
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi