Member since
01-18-2016
163
Posts
32
Kudos Received
19
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1378 | 04-06-2018 09:24 PM | |
1400 | 05-02-2017 10:43 PM | |
3836 | 01-24-2017 08:21 PM | |
23550 | 12-05-2016 10:35 PM | |
6450 | 11-30-2016 10:33 PM |
05-18-2016
01:41 PM
What am I missing? I'm using JConsole connected to my Kafka 0.9.0 broker to find this: kafka.consumer:type=ConsumerFetcherManager,name=MaxLag,clientId=([-.\w]+) However, there is no kafka.consumer.* (nor kafka.producer.* for that matter). Thanks.
... View more
Labels:
- Labels:
-
Apache Kafka
05-17-2016
02:47 AM
Thanks for the info @swagle. We were able to convince the customer to upgrade to Ambari 2.2.2. They were thrilled with the fact that you can add widgets directly in the UI, and the fact that Grafana is available is icing on the cake. Incidentally, here is the JIRA for adding this for Kafka and Storm: https://issues.apache.org/jira/browse/AMBARI-14941
... View more
05-16-2016
06:41 PM
These files have stuff like this in them, so how do I get this info in Ambari? {
"KAFKA_BROKER": {
"Component": [
{
"type": "ganglia",
"metrics": {
"default": {
"metrics/jvm/uptime": {
"metric": "jvm.uptime",
"pointInTime": true,
"temporal": true
},
/* -- SNIP -- */
"metrics/kafka/server/BrokerTopicMetrics/AllTopicsBytesInPerSec/count": {
"metric": "kafka.server.BrokerTopicMetrics.BytesInPerSec.count",
"pointInTime": true,
"temporal": true
},
"metrics/kafka/server/BrokerTopicMetrics/AllTopicsBytesOutPerSec/1MinuteRate": {
"metric": "kafka.server.BrokerTopicMetrics.BytesOutPerSec.1MinuteRate",
"pointInTime": true,
"temporal": true
},
"metrics/kafka/server/BrokerTopicMetrics/AllTopicsBytesOutPerSec/5MinuteRate": {
"metric": "kafka.server.BrokerTopicMetrics.BytesOutPerSec.5MinuteRate",
"pointInTime": true,
"temporal": true
},
"metrics/kafka/server/BrokerTopicMetrics/AllTopicsBytesOutPerSec/15MinuteRate": {
"metric": "kafka.server.BrokerTopicMetrics.BytesOutPerSec.15MinuteRate",
"pointInTime": true,
"temporal": true
},
"metrics/kafka/server/BrokerTopicMetrics/AllTopicsBytesOutPerSec/meanRate": {
"metric": "kafka.server.BrokerTopicMetrics.BytesOutPerSec.meanRate",
"pointInTime": true,
"temporal": true
},
"metrics/kafka/server/BrokerTopicMetrics/AllTopicsBytesOutPerSec/count": {
"metric": "kafka.server.BrokerTopicMetrics.BytesOutPerSec.count",
"pointInTime": true,
"temporal": true
},
"metrics/kafka/controller/KafkaController/ActiveControllerCount": {
"metric": "kafka.controller.KafkaController.ActiveControllerCount",
"pointInTime": true,
"temporal": true
},
... View more
05-16-2016
03:30 PM
1 Kudo
I'm looking for a way to integrate some of the Kafka JMX metrics into Ambari monitoring and alerting if possible. The installation I will be working with is HDP 2.3.4, but at the moment I'm looking at the 2.4 sandbox. In the sandbox, I see these two files which are very similar: /var/lib/ambari-server/resources/stacks/HDP/2.3/services/KAFKA/metrics.json /var/lib/ambari-server/resources/common-services/KAFKA/0.8.1.2.2/metrics.json They appear to be for collecting JMX metrics, but I'm not sure how to take advantage of this. Is it possible? Thanks
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Kafka
05-09-2016
03:55 PM
1 Kudo
If your index is of any significant size or has much of a load on it, I would recommend you install it on separate nodes.
... View more
05-05-2016
07:30 PM
Doing "vagrant suspend" and "vagrant resume" doesn't seem to bring things up cleanly. Thanks
... View more
Labels:
- Labels:
-
Apache Metron
05-02-2016
05:47 PM
I had something like this happen on my 16G macbook pro when I switched from 0.4.1 to 0.6.0 and reused the repository directories. It was just an experimental instance, so I abandoned the original repos and started from scratch, except for importing a few flows. I have not had the problem since. The odd thing in my case is that it was fine in 0.4.1 but not in 0.6.0.
... View more
04-28-2016
01:31 PM
2 Kudos
I wanted to offer another comparison tool option. After downloading configs, you might consider using a graphical tool like meld. It does a very nice job of file and directory comparison and merges. It will not only point out line differences but highlight character differences. Check out the images on their home page to know what to expect: http://http://meldmerge.org If you're doing a shell comparison using diff, try the -y option for a side-by-side diff. And there is a recursive option -r to compare directories. diff -ry <dirA> <dirB>
... View more
04-27-2016
07:15 PM
Awesome! Thanks for the full sample. By digging through source code I figured out that I could use the property object with evaluateExpressions(flowFile), but I did not realize that testProperty is a property already. duh. This is what I had tried but it printed "null", so assumed I was going down the wrong path.
flowFile = session.get()
if(!flowFile) return
def retVal = context.getProperty('testProperty').evaluateExpressions(flowFile)
log.info("-----------------------"+retVal?.value)
session.transfer(flowFile, REL_SUCCESS)
... View more
04-27-2016
05:33 PM
In an ExecuteScript processor, I added a property called testProperty and set the value to ${filename}. But when I reference it in my groovy script, I get "${filename}" rather than the value of the 'filename' in the incoming flowfile. ExecuteSripts says that properties support expression language, but I'm not seeing it. My test script is simple and I watch the logs. log.info(" -------------------------" + testProperty) It prints this but filename is a pre-existing attribute: -------------------------${filename} Thanks, Jim
... View more
Labels:
- Labels:
-
Apache NiFi