Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2438 | 04-27-2020 03:48 AM | |
4862 | 04-26-2020 06:18 PM | |
3967 | 04-26-2020 06:05 PM | |
3205 | 04-13-2020 08:53 PM | |
4902 | 03-31-2020 02:10 AM |
01-03-2017
02:31 PM
@Wael Horchani Zeppelin View is Iframe based view so please make sure that whatever host name you see there in the IFrame window, is accessible/resolvable from the host where you are opening the browser. Try putting the mentioned hostname with the IP address in your local machine.
... View more
01-03-2017
10:33 AM
@Wael Horchani - Do you have correct hostname mapping in your cluster? - Can you check if all the hosts have the correct "hostname -f" output? Also the "/etc/hosts" file mapping? All the hosts in the cluster should be able to access eachother with the correct hostname. - Do you see the correct hostname while making the following API call: http://AMBARI_HOSTNAME:8080/api/v1/clusters/CLUSTER_NAME/hosts/ - Also are you able to access the Zeppelin UI directly using the correct hostname ? If not then you will need to fix the hostname / DNS resolution.
http://ZEPPELIN_HOST:9995/ .
... View more
01-03-2017
09:28 AM
@Asier Gomez Another quick test. Are you able to open the file for cat as following (that will help us in understandaing if there are any special character issue/ new line issue) Example: hdfs dfs -cat /tmp/data/geolocation.csv | head $ hdfs dfs -cat /tmp/data/geolocation.csv | head
truckid,driverid,event,latitude,longitude,city,state,velocity,event_ind,idling_ind
A54,A54,normal,38.440467,-122.714431,Santa Rosa,California,17,0,0
A20,A20,normal,36.977173,-121.899402,Aptos,California,27,0,0
A40,A40,overspeed,37.957702,-121.29078,Stockton,California,77,1,0
A31,A31,normal,39.409608,-123.355566,Willits,California,22,0,0
A71,A71,normal,33.683947,-117.794694,Irvine,California,43,0,0
A50,A50,normal,38.40765,-122.947713,Occidental,California,0,0,1
A51,A51,normal,37.639097,-120.996878,Modesto,California,0,0,1
A19,A19,normal,37.962146,-122.345526,San Pablo,California,0,0,1
A77,A77,normal,37.962146,-122.345526,San Pablo,California,25,0,0 .
... View more
01-03-2017
09:16 AM
@Asier Gomez Can you please share the output of the following command: $ hdfs dfs -ls /tmp/data/geolocation.csv - We will need to check two things here 1. The file exist 2. The file has proper read permission for the user 3. Is this the same "Geolocation.zip" (geolocation.csv) file you are using which is shown as part of the demo: http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/ - I just quickly tested this "geolocation.csv" file at my end ant it works fine. .
... View more
12-29-2016
07:19 AM
@Qinglin Xia Additionally if you due to some reason if the Ambari is down (not accessible) and still if you want to get the Active HBase Master detail then you can simply use the HBase JMX for the same. Here "16010" is HBase JMX ui port. Exampe: $ curl -v --silent 'http://erie4.example.com:16010/jmx?qry=Hadoop:service=HBase,name=Master,sub=Server' 2>&1 | grep isActiveMaster
"tag.isActiveMaster" : "true",
$ curl -v --silent 'http://erie3.example.com:16010/jmx?qry=Hadoop:service=HBase,name=Master,sub=Server' 2>&1 | grep isActiveMaster
"tag.isActiveMaster" : "false",
... View more
12-28-2016
10:10 AM
1 Kudo
@Qinglin Xia More easy command to access this info using curl by hitting the URL: http://erie1.example.com:8080/api/v1/clusters/ErieCluster/hosts/erie3.example.com/host_components/HBASE_MASTER?fields=metrics/hbase/master/IsActiveMaster curl -u admin:admin -H "X-Requested-By: ambari" -X GET http://erie1.example.com:8080/api/v1/clusters/ErieCluster/hosts/erie4.example.com/host_components/HBASE_MASTER?fields=metrics/hbase/master/IsActiveMaster
{
"href" : "http://erie1.example.com:8080/api/v1/clusters/ErieCluster/hosts/erie4.example.com/host_components/HBASE_MASTER?fields=metrics/hbase/master/IsActiveMaster",
"HostRoles" : {
"cluster_name" : "ErieCluster",
"component_name" : "HBASE_MASTER",
"host_name" : "erie4.example.com"
},
"host" : {
"href" : "http://erie1.example.com:8080/api/v1/clusters/ErieCluster/hosts/erie4.example.com"
},
"metrics" : {
"hbase" : {
"master" : {
"IsActiveMaster" : "true"
}
}
}
} .
... View more
12-28-2016
09:40 AM
@Qinglin Xia You can use the Ambari APIs to find that out using simple "curl" GET you should be able to find the Active HBase Master: http://erie1.example.com:8080/api/v1/clusters/ErieCluster/components/HBASE_MASTER?ServiceComponentInfo/category=MASTER&fields=ServiceComponentInfo/service_name,host_components/HostRoles/display_name,host_components/metrics/hbase/master/IsActiveMaster Example Output: {
"href" : "http://erie1.example.com:8080/api/v1/clusters/ErieCluster/components/HBASE_MASTER?ServiceComponentInfo/category=MASTER&fields=ServiceComponentInfo/service_name,host_components/HostRoles/display_name,host_components/metrics/hbase/master/IsActiveMaster",
"ServiceComponentInfo" : {
"category" : "MASTER",
"cluster_name" : "ErieCluster",
"component_name" : "HBASE_MASTER",
"service_name" : "HBASE"
},
"host_components" : [
{
"href" : "http://erie1.example.com:8080/api/v1/clusters/ErieCluster/hosts/erie3.example.com/host_components/HBASE_MASTER",
"HostRoles" : {
"cluster_name" : "ErieCluster",
"component_name" : "HBASE_MASTER",
"display_name" : "HBase Master",
"host_name" : "erie3.example.com"
},
"metrics" : {
"hbase" : {
"master" : {
"IsActiveMaster" : "false"
}
}
}
},
{
"href" : "http://erie1.example.com:8080/api/v1/clusters/ErieCluster/hosts/erie4.example.com/host_components/HBASE_MASTER",
"HostRoles" : {
"cluster_name" : "ErieCluster",
"component_name" : "HBASE_MASTER",
"display_name" : "HBase Master",
"host_name" : "erie4.example.com"
},
"metrics" : {
"hbase" : {
"master" : {
"IsActiveMaster" : "true"
}
}
}
}
]
} Notice: "IsActiveMaster" : "false" .
... View more
12-28-2016
09:24 AM
@Zhao Chaofeng Also can you please share the output of the following command "klist -e -k /etc/security/keytabs/hdfs.headless.keytab" to see the encryption types used by the kerberos tickets? # klist -e -k /etc/security/keytabs/hdfs.headless.keytab
Keytab name: FILE:/etc/security/keytabs/hdfs.headless.keytab
KVNO Principal
---- --------------------------------------------------------------------------
4 hdfs-JoyCluster@EXAMPLE.COM (des3-cbc-sha1)
4 hdfs-JoyCluster@EXAMPLE.COM (arcfour-hmac)
4 hdfs-JoyCluster@EXAMPLE.COM (aes128-cts-hmac-sha1-96)
4 hdfs-JoyCluster@EXAMPLE.COM (des-cbc-md5)
4 hdfs-JoyCluster@EXAMPLE.COM (aes256-cts-hmac-sha1-96)
.
... View more
12-28-2016
09:20 AM
@Zhao Chaofeng - Please check if the "Reverse lookup" is correct or not on that host? - Also it will be best if you can share the output of to see the kerberos related JAVA options used. ps -ef | grep AmbariServer
ps -ef | grep NameNode - Just to verify the correct JAVA Path which has the JCE. .
... View more
12-28-2016
09:04 AM
@Zhao Chaofeng Since how long you are facing this issue? I mean is there a recent change happened? Or any recent upgrade? What is your HDP and Ambari Version? Only the NameNode is failing with the mentioned "GSS initiate failed", or few other components are also falling with the same issue. I am sure that the Hostname is correct (example: hostname -f). Still it is worth to check. - Is this kind of issue happening on the same host "bigdata013.example.com/<ip-address>:8020" ? Is this the only host (and the components hosted in this host) are giving the "GSS initiate failed" ? Or other hosts of your cluster are also having this issue?
- Worth to check the hostname & KDC Connectivity.
... View more