Member since
04-22-2016
931
Posts
46
Kudos Received
26
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1850 | 10-11-2018 01:38 AM | |
| 2213 | 09-26-2018 02:24 AM | |
| 2242 | 06-29-2018 02:35 PM | |
| 2910 | 06-29-2018 02:34 PM | |
| 6091 | 06-20-2018 04:30 PM |
03-21-2017
02:32 PM
I solved this problem using the following method , but I do want to know why would one want to use the SERDE method and not this one? [hbase@hadoop1 ~]$ more a.csv
5842,50,30,4,240,340
5843,52,32,5,250,360
5844,56,31,2,248,333
[hbase@hadoop1 ~]$
create table test3(Id int, lowT string, highT string,vib int, lowP string,highP string) ROW FORMAT DELIMITED FIELDS TERMINATED BY "," STORED AS TEXTFILE
TBLPROPERTIES("skip.header.line.count"="1");
load data inpath '/user/hbase/a.csv' OVERWRITE INTO TABLE test3;
Loading data to table default.test3
Table default.test3 stats: [numFiles=1, numRows=0, totalSize=63, rawDataSize=0]
OK
Time taken: 0.668 seconds
... View more
01-31-2017
07:19 PM
@Sami Ahmad can you let us know the value of the property when yarn RM HA was done. This can be achieved by using the API is described in my last comment http://localhost:8080/api/v1/clusters/c1/configurations/service_config_versions?service_name=YARN&service_config_version_note=This%20configuration%20is%20created%20by%20Enable%20ResourceManager%20HA%20wizard I am trying to understand if that yarn property was set to true when RAM HA was done for the very first time and then later got reverted to false OR value of that property was false even when RM HA was completed We can know that by looking into the property value by using above API as that service config version is created when YARN RM HA is completed. Also let us know ambari version. It allows us to look into the correct version of ambari code and verify if it's a bug specific to the ambari version that you are using or not.
... View more
01-09-2017
08:11 PM
1 Kudo
Hi @Sami Ahmad, 1. 2 Hours should be sufficient for any questions you will get asked. But only in case you know what to do and don't need to read too much documentation. I've done certification about a month ago. The only recommendation: do install test VM on AWS as recommended and try to complete test exam prior to your actual exam. 2. You don't need to remember how to create script, but you need to be familiar with content and have skills in rack awareness configuration using Ambari. Good luck!
... View more
01-04-2017
07:39 PM
@Sami Ahmad Below is the simple wordcount example from Spark docs and this should work with both Spark 1.6.x and Spark 2.x. >>> textFile = sc.textFile("file:///etc/passwd")
>>> wordCounts = textFile.flatMap(lambda line: line.split()).map(lambda word: (word, 1)).reduceByKey(lambda a, b: a+b)
>>> wordCounts.collect() Ref: http://spark.apache.org/docs/latest/quick-start.html#more-on-rdd-operations Hope this helps.
... View more
01-03-2017
06:57 PM
thank you that exactly was the issue, I added the user to all the nodes of the cluster and now hive works.
... View more
01-03-2017
10:46 PM
You may find this useful as well for future. https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients Also, be advised ranger only works with hiveserver2.
... View more
12-28-2016
10:38 PM
Hi @Sami Ahmad As per the attached screenshot you are getting error in the "Check Kerberos" action from one of the randomly selected client host by the ambari. It seems that install kerberos client went ok on all nodes. Its the kerberos service check that failed and so I believed issue was not on any particular client host. In this case if ambari would have selected any other kerberos client host to do service check, then the action would have failed even on that host.
... View more
12-28-2016
06:52 PM
@Sami Ahmad "Configure Identities" is related to creating and customizing principal/keytab for the new service being added which is required if you have Kerberos environment. That screen is shown only if you have enabled Kerberos in your setup and then add a service. If you don't have Kerberos service in your cluster that screen will not be shown and that is an expected behavior.
... View more
12-28-2016
06:31 PM
Do you have the MIT KDC set up ? If not then please install it as documented below: https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.2.1/bk_Ambari_Security_Guide/content/_optional_install_a_new_mit_kdc.html Once done choose the option "Use an Existing MIT KDC"
... View more