Member since
01-14-2019
28
Posts
14
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1417 | 11-30-2016 04:08 PM | |
8641 | 04-22-2016 09:30 PM |
03-16-2017
09:16 PM
Before performing failover, it is a good idea to also check following: The other namenode is alive and not in safemode. The other namenode shows all expected datanodes alive.
... View more
12-09-2016
03:27 PM
Hi Michael, I'm still trying to figure out where to find that log (is there any folder?).
I've tried finding the Query ID that Hive shows once i execute a query, but couldn't find it.
Query ID = root_20161205190741_fb2a555d-1633-404d-9128-0c3696d2d56a Until now, i've just found the following exception (through CLI) after execution fails: Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1480931794353_0004_1_00, diagnostics=[Task failed, taskId=task_1480931794353_0004_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space Any suggestion? Regards and thank you Michael for helping me
... View more
08-03-2016
05:45 PM
Oh, sorry misread the path... it works. much appreciated!
... View more
10-04-2016
09:34 AM
After performing the mentioned steps i'm still facing the same issue. The alert is same: “Connection failed: [Errno 111] Connection refused to localhost:6667” curl -u admin:admin -H 'X-Requested-By: ambari' -X GET "http://localhost:8080/api/v1/clusters/XXXX/alert_definitions/17"
{
"href" : "http://localhost:8080/api/v1/clusters/flumetest/alert_definitions/17",
"AlertDefinition" : {
"cluster_name" : "XXXX",
"component_name" : "KAFKA_BROKER",
"description" : "This host-level alert is triggered if the Kafka Broker cannot be determined to be up.",
"enabled" : true,
"id" : 17,
"ignore_host" : false,
"interval" : 1,
"label" : "Kafka Broker Process",
"name" : "kafka_broker_process",
"scope" : "HOST",
"service_name" : "KAFKA",
"source" : {
"default_port" : 9092.0,
"reporting" : {
"critical" : {
"value" : 5.0,
"text" : "Connection failed: {0} to {1}:{2}"
},
"warning" : {
"value" : 1.5,
"text" : "TCP OK - {0:.3f}s response on port {1}"
},
"ok" : {
"text" : "TCP OK - {0:.3f}s response on port {1}"
}
},
"type" : "PORT",
"uri" : "{{kafka-broker/listeners}}"
}
}
}
After changing the listener port in config to : 9092 I'm getting: Connection failed: [Errno 111] Connection refused to localhost:9092
... View more
05-26-2016
03:40 PM
I ssume also tha Hive with PAM authentication will also be a viable option on Azure. https://community.hortonworks.com/articles/591/using-hive-with-pam-authentication.html
... View more
05-10-2016
01:42 PM
Hi Ed, It would be useful to know if you are aiming for HA or performance. Since it is a small cluster you may use it as a POC and not care much about HA, I don't know. One option not mentioned below is going with 3 masters and 3 slaves in a small HA cluster setup. That allows you to balance services on the masters more and/or dedicate one to be mostly an edge node. If security is a topic that may come in handy. Cheers, Christian
... View more
04-22-2016
09:31 PM
Oh and don't forget to put a PutSQL processor to actually execute the sql command that ConvertJSONToSQL processor does for you 🙂
... View more