Member since
05-30-2018
1322
Posts
715
Kudos Received
148
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3363 | 08-20-2018 08:26 PM | |
1483 | 08-15-2018 01:59 PM | |
1884 | 08-13-2018 02:20 PM | |
3363 | 07-23-2018 04:37 PM | |
4074 | 07-19-2018 12:52 PM |
07-18-2018
03:46 PM
@Yolanda M. Davis Thanks for your response. I have tried 7 different combos the the ambari alert and all seem to fail. Here is the ambari alert without default port and the port included in the uri {
"AlertDefinition" : {
"cluster_name" : "kafka-wiz",
"component_name" : "KAFKA_BROKER",
"description" : "This kafka broker alert is triggered if input bytes mean rate exeeds 25.",
"enabled" : true,
"help_url" : null,
"ignore_host" : false,
"interval" : 1,
"label" : "[CUSTOM7] Kafka Broker Alert",
"name" : "kafka_broker_mean_rate7",
"repeat_tolerance" : 1,
"repeat_tolerance_enabled" : false,
"scope" : "ANY",
"service_name" : "KAFKA",
"source" : {
"jmx" : {
"property_list" : ["kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec/MeanRate"],
"value" : "{0}"
},
"reporting" : {
"ok" : {
"text" : "Kafka input mean rate: {0}"
},
"warning" : {
"text" : "Kafka input mean rate: {0}",
"value" : 25
},
"critical" : {
"text" : "Kafka input mean rate: {0}",
"value" : 50
},
"units" : "bytes"
},
"type" : "METRIC",
"uri" : { "http" : "kafka-xxx-messaging-1.xxx.xxxxx.com:16667"}
}
}
}
I verified I am able to connect via jconsole on that port.
... View more
07-13-2018
03:25 PM
You have to tell hive more about your data characteristics. On hive do this: CREATE EXTERNAL TABLE sourcetable (col bigint)
row format delimited
fields terminated by ","
STORED as TEXTFILE
TBLPROPERTIES("orc.compress"="snappy")
LOCATION 'hdfs:///data/sourcetable'
... View more
07-12-2018
08:48 PM
I have created a custom kafka ambari alert. I have verified I am able to connect via jconsole to view the kafka jmx metrics The error on ambari alert is: [Alert][kafka_broker_mean_rate5] Unable to extract JSON from JMX response My alerts.json: {
"AlertDefinition" : {
"cluster_name" : "kafka-wiz",
"component_name" : "KAFKA_BROKER",
"description" : "This kafka broker alert is triggered if input bytes mean rate exeeds 25.",
"enabled" : true,
"help_url" : null,
"ignore_host" : false,
"interval" : 1,
"label" : "[CUSTOM6] Kafka Broker Alert",
"name" : "kafka_broker_mean_rate6",
"repeat_tolerance" : 1,
"repeat_tolerance_enabled" : false,
"scope" : "ANY",
"service_name" : "KAFKA",
"source" : {
"jmx" : {
"property_list" : ["kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec/MeanRate"],
"value" : "{0}"
},
"reporting" : {
"ok" : {
"text" : "Kafka input mean rate: {0}"
},
"warning" : {
"text" : "Kafka input mean rate: {0}",
"value" : 25
},
"critical" : {
"text" : "Kafka input mean rate: {0}",
"value" : 50
},
"units" : "bytes"
},
"type" : "METRIC",
"uri" : { "http" : "xxxx.field.xxx.com",
"default_port" : 16667 }
}
}
}
Any feedback appreciated.
... View more
Labels:
- Labels:
-
Apache Ambari
07-11-2018
10:44 PM
found the issue. https://community.hortonworks.com/questions/202271/cloudbreak-cluster-fails-with-infrastructure-creat-2.html
... View more
07-11-2018
09:32 PM
I am using cloudbreak to create HDP Version
2.6.5.0-292 cluster. After being in create progress for 45 minutes, it failed with error: Infrastructure creation failed. Reason: Failed to retrieve the server's certificate
7/11/2018, 4:15:48 PM Any ideas?
... View more
Labels:
- Labels:
-
Hortonworks Cloudbreak
07-11-2018
02:32 PM
That is a unbounded question. Knowing your use case would provide more value. For example, if you want to expose a single url for NiFi development on the UI, you could use LB with sticky sessions. Again your question is unbouded and better off you share your use case in another HCC question.
... View more
07-11-2018
05:06 AM
NiFi Implemented zero master since 1.0. generally you don't need a LB but for certain use cases it may be required.
... View more
07-11-2018
05:03 AM
Take a look at spark.driver.userClassPathFirst and spark.executor.userClassPathFirst https://spark.apache.org/docs/latest/configuration.html
... View more
07-11-2018
04:55 AM
NiFi sizing is well documented here: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.1/bk_planning-your-deployment/content/ch_hardware-sizing.html Here is a snippet: In terms of configuration for best performance, take a look here: https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.html In terms of deployment guild, take a look here: https://community.hortonworks.com/articles/135337/nifi-sizing-guide-deployment-best-practices.html
... View more
07-10-2018
07:29 PM
@Dominika Bialek This was helpful. As a follow up to others who may see this, you have to use the fully qualified name arn:aws:iam::AccountNumber:role/CredentialRole
... View more